Skip to main content
Version: 4.52.0

File System Crawler

The FS Crawler, or File System Crawler, allows you to recursively scrape a directory on a filesystem or retrieve the metadata of a single file. The local file system or a cloud storage can be used. In order to access the local filesystem, the XILL4_WORKDIRS environment variable must be set to the path of the directory to be accessed.

Configuration

Inputs | Outputs


FS Crawler
Input
Output
Error
00 0 (ilywsc4)
This input takes objects that have a fullPath key that contains the path to scrape. This can either be a path to a file or a directory. If the recursive key is set to false, only the current directory entries will be output. If the recursive key is set to true, all directory entries of the sub-folders will be output as well.

note
When fullPath is a file, the recursive key is ignored and can be omitted.

Example:
{
"fullPath" : "C:/Users",
"recursive": true
}
If the incoming data doesn't have fullPath defined, the component will check for the configuration. At least one of the two is required.