File System Crawler
The FS Crawler, or File System Crawler, allows you to recursively scrape a directory on a filesystem or retrieve the metadata of a single file. The local file system or a cloud storage can be used. In order to access the local filesystem, the XILL4_WORKDIRS
environment variable must be set to the path of the directory to be accessed.
Configuration
Inputs | Outputs
This input takes objects that have a
Example:If the incoming data doesn't have
fullPath
key that contains the path to scrape. This can either be a path to a file or a directory. If the recursive
key is set to false, only the current directory entries will be output. If the recursive
key is set to true, all directory entries of the sub-folders will be output as well.note
When
fullPath
is a file, the recursive
key is ignored and can be omitted.Example:
{
"fullPath" : "C:/Users",
"recursive": true
}
fullPath
defined, the component will check for the configuration. At least one of the two is required.