Sign Up
Loading...

Scheduled CSV downloads and automated processing

Asked by Gabor on January 11, 2025

Can Twidget schedule the download of CSV files from a URL, process them automatically (exclude/rename columns, rewrite values), and forward the processed data to a webshop via API?


Answered by Twidget

Yes. Use Twidget’s Events feature to schedule CSV downloads. Build commands to fetch the CSV text, parse and process it (rename/exclude columns, transform values), and then send the processed data to the target webshop via HTTP requests.

Related Questions

Accessing JSON response fields and troubleshooting null results

To access an HTTP response, use response properties such as .status and .data, and reference fields with dot notation (e.g., response.data.fieldName). See: https://www.youtube.com/watch?v=IrY_7xnA10g

If database operations return null during endpoint tests, ensure you have Live Data enabled...

Managing a timed queue in a database array

Use scheduled Events. Create an event that runs every 60 seconds and updates the database array (remove the first item). The scheduled event can fetch the record, modify the array (shift/remove the first element), and save the updated array back to the datastore. See the scheduled events tutorial...

Dashes in variable names and header "Content‑Type"

Dashes are allowed in object field names but when creating variable names the platform converts dashes to underscores. If you need a variable name, use underscores; for object fields you can use dashes where supported.

Using Twidget to simplify Telegram bot API calls

Create a Twidget endpoint that orchestrates the required API calls. Add steps to call each external API (Telegram, Gemini, short link, Bluesky). Your bot then makes a single request to the Twidget endpoint, which performs the calls and returns the combined result. Store API keys as global variabl...

Including query parameters and auth tokens in URLs

Query parameters are passed after a "?" in the URL. For example: api.example.com/check/{auth_token}?query={query_parameter}. Note that it’s more secure to send auth tokens in an Authorization header rather than embedding them in the URL. See the tutorial: https://www.youtube.com/watch?v=iHULlNQ5K...