Preparing RSS Data for LLMs
Sometimes RSS data arrives inconsistent or overloaded, and for this you trim each article down to the essentials so the LLM can produce a clean tweet every time. The goal is simple, each article should reach the LLM in a clean, compact form that turns into a single tweet.
- Aggregate a small feed and test if the LLM can handle it;
- If mapping looks clunky, normalize with a Code node;
- Loop over items with a batch size of 1 so each article is processed into a single tweet.
Start by aggregating the feed in small batches. Use Aggregate to combine all items into a single list, creating one item that contains an array of about 25 articles in JSON format. This gives you a quick, low-complexity setup. Test this aggregated result with your LLM by mapping the array into the Context field. If the output looks unclear or inconsistent, move on to normalization.
To normalize, copy a sample of the RSS JSON and ask your LLM to produce a Code node that removes HTML, extracts the first image URL, standardizes fields such as title, text, url, guid, and publishedAt, removes near-duplicate titles, and returns one clean item per article as an array. Place this Code node immediately after the RSS or RSS Read node.
Next, replace the aggregate path with a loop. Use Loop or Split in Batches with a batch size of one to emit one article at a time, which is ideal for generating a single tweet per pass. Finally, add your chat model inside the loop, map the normalized article text (and any hooks) into Context, and provide a short, clear system instruction for tweet tone and style.
Tack för dina kommentarer!
Fråga AI
Fråga AI
Fråga vad du vill eller prova någon av de föreslagna frågorna för att starta vårt samtal
Awesome!
Completion rate improved to 4.17Preparing RSS Data for LLMs
Svep för att visa menyn
Sometimes RSS data arrives inconsistent or overloaded, and for this you trim each article down to the essentials so the LLM can produce a clean tweet every time. The goal is simple, each article should reach the LLM in a clean, compact form that turns into a single tweet.
- Aggregate a small feed and test if the LLM can handle it;
- If mapping looks clunky, normalize with a Code node;
- Loop over items with a batch size of 1 so each article is processed into a single tweet.
Start by aggregating the feed in small batches. Use Aggregate to combine all items into a single list, creating one item that contains an array of about 25 articles in JSON format. This gives you a quick, low-complexity setup. Test this aggregated result with your LLM by mapping the array into the Context field. If the output looks unclear or inconsistent, move on to normalization.
To normalize, copy a sample of the RSS JSON and ask your LLM to produce a Code node that removes HTML, extracts the first image URL, standardizes fields such as title, text, url, guid, and publishedAt, removes near-duplicate titles, and returns one clean item per article as an array. Place this Code node immediately after the RSS or RSS Read node.
Next, replace the aggregate path with a loop. Use Loop or Split in Batches with a batch size of one to emit one article at a time, which is ideal for generating a single tweet per pass. Finally, add your chat model inside the loop, map the normalized article text (and any hooks) into Context, and provide a short, clear system instruction for tweet tone and style.
Tack för dina kommentarer!
