Tag See all →

#data-pipelines

2 stories

Banner: DuckDB read S3 Parquet files locally but got 403 in the container, secrets and the credential chain

Cloud & Infrastructure Bug Report

DuckDB read S3 Parquet files locally but got 403 in a container: secrets and the credential chain

Le Minh Khoa · Sep 6, 2026 · 7 min read

A DuckDB report job queried Parquet files on S3 fine on a laptop and failed with HTTP 403 in its ECS task. Locally DuckDB used a persistent secret from personal credentials; in the container nothing told it to use the task role. How DuckDB secrets and the credential chain work, plus the KMS detail.

Banner: LLM batch job expired and results were matched to the wrong records

AI & Machine Learning Bug Report

LLM Batch API job expired and our pipeline wrote results to the wrong rows

Ryan Pham · Feb 4, 2026 · 6 min read

Our nightly product description job used the Batch API to save cost. One night the batch expired with 30 percent unfinished, and our importer joined results by line position, so descriptions landed on the wrong products. We now join by custom_id and handle every terminal status.