Repository navigation
s3.fileName does not support folders #294
Description
Whenever I try submitting a job with a path in "s3.fileName", I get an error like this
{"error":"Bad parameters","status":400,"object":["248 : File name has bad format"]}
Here is sample query request with redacted details:
{
"query": "[redacted]",
"from": "5m",
"to": "now",
"mode": {
"type": "json/simple"
},
"destination": {
"type": "s3",
"params": {
"aws.bucket": "[redacted]",
"aws.region": "us-east-2",
"aws.accesskey": "[redacted]",
"aws.secretkey": "[redacted]",
"format": "gzip",
"s3.fileName":"datadrop/devo_20250131004128"
}
}
}
I would expect that forward slashes in S3 file name should be accepted in order to be able to put files into specific folders. Without this, Devo always writes to the root of the bucket, which is a problem.
Activity
franjuan commentedon May 26, 2025
Hi @greg-anetac,
By default, the Query API — which is the backend used by the Devo Python SDK — enforces a filename restriction that requires the name to match the following regular expression:
^[\\w\\-. ]+$. As you can see, the/character is not included in the allowed pattern, so filenames containing it are rejected.We've shared this limitation with our colleagues responsible for the backend, and we hope it will be addressed in the future. However, we can't guarantee a timeline at the moment.
Thanks!