pachctl put file

pachctl put file #

Put a file into the filesystem.

Synopsis #

This command puts a file into the filesystem. This command supports a number of ways to insert data into PFS.

Files, Directories, & URLs: To upload via local filesystem, use the -f flag To upload via URL, use the -f flag with a URL as the argument To upload via filepaths & urls within a file, use the i flag To upload to a specific path in the repo, use the -f flag and add the path to the repo@branch:/path To upload recursively from a directory, use the -r flag To upload tar files and have them automatically untarred, use the -untar flag

Compression, Parallelization, Appends: To compress files before uploading, use the -c flag To define the maximum number of files that can be uploaded in parallel, use the -p flag To append to an existing file, use the -a flag

pachctl put file <repo>@<branch-or-commit>[:<path/to/file>] [flags]

Examples #

 pachctl put file repo@master -f image.png 
 pachctl put file -r repo@master -f my-directory 
 pachctl put file -r repo@branch:/path -f my-directory 
 pachctl put file -r repo@branch -f s3://my_bucket 
 pachctl put file repo@branch -f http://host/example.png 
 pachctl put file repo@branch:/dir/ -f http://host/example.png 
 pachctl put file repo@branch -i file 
 pachctl put file repo@branch -i http://host/path 
 pachctl put file --untar repo@branch -f dir.tar 
 pachctl put file -c repo@branch -f image.png

Options #

  -a, --append              Specify file contents should be appended to existing content from previous commits or previous calls to 'pachctl put file' within this commit.
  -c, --compress            Specify data should be compressed during upload. This parameter might help you upload your uncompressed data, such as CSV files, to Pachyderm faster. Use 'compress' with caution, because if your data is already compressed, this parameter might slow down the upload speed instead of increasing.
  -f, --file strings        Specify the file to be put; it can be a local file or a URL. (default [-])
      --full-path           Specify entire path provided to -f should be the target filename in PFS; by default only the base of the path is used.
  -h, --help                help for file
  -i, --input-file string   Specify file provided contains a list of files to be put (as paths or URLs).
  -p, --parallelism int     Set the maximum number of files that can be uploaded in parallel. (default 10)
      --progress            Print progress bars. (default true)
      --project string      Specify the project (by name) where the repo for uploading this file is located. (default "video-to-frame-traces-test")
  -r, --recursive           Specify files should be recursively put into a directory.
      --untar               Specify file(s) with the extension .tar should be untarred and put as a separate file for each file within the tar stream(s); gzipped (.tar.gz or .tgz) tar file(s) are handled as well

Options inherited from parent commands #

      --no-color               Turn off colors.
      --rpc-timeout duration   If non-zero, perform all client operations with this RPC deadline.
  -v, --verbose                Output verbose logs.

Article Summarization