Skip to content

jblukach/getmeta

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

42 Commits
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

getmeta

Installation

curl https://sh.rustup.rs -sSf | sh -s -- -y
source "$HOME/.cargo/env"

Development

cargo build
cargo run

Artifacts

  • amiid
  • fpath
  • fname
  • fsize
  • b3hash
  • b3name
  • b3path
  • b3dir

Normalization

  • Linux operating systems normalize the accounts in the home directory to the word user for the account.
  • Macintosh operating systems normalize accounts in the Users directory to the word user except for the Shared account.
  • Windows operating systems normalize accounts in the Users directory to the word user except for the Default and Public accounts.
  • File names and paths containing a , character a.k.a. comma, are converted to ||| a.k.a. three pipes for storage.

Local Usage

getmeta

Cloud Usage

Once written, the Apache parquet file gets shipped to an AWS S3 Bucket for host offloading.

getmeta <bucket> <region> <prefix>

Classifications

  • DENIED Permission Issue
  • EMPTY Empty File Hash
  • ERROR Content Hash Error
  • LARGE File Size 1+ GB
  • ZERO Zero File Size

Requirements

Amazon Linux

yum install gcc git openssl-devel -y

SUSE Linux

zypper patch
zypper install gcc git openssl-devel pkg-config

Ubuntu Linux

apt-get update
apt-get install gcc libssl-dev pkg-config -y

Binary Build

git clone https://github.com/jblukach/getmeta.git
cargo build --release

Meta Information