What this skill does

# AgResource Newsletter Scraper Use this skill to scrape, summarize, and analyze AgResource grain marketing newsletters. ## Implementation - **Scraper:** `scraper.js` (Playwright/Node.js) - **Sentiment Analyzer:** `agresource_sentiment.py` (Python) - **Login:** Automatic using `AGRESOURCE_EMAIL` and `AGRESOURCE_PASSWORD` env vars ## Capabilities - Log in to AgResource dashboard (https://agresource.com/dashboard/#/reports/daily) - Scrape daily newsletter content using Playwright - Save screenshot for reference/debugging - Extract corn/soybean sales advice and recommendations - Generate concise summaries with key news and weather tidbits - Analyze sentiment (bullish/bearish) across newsletters - Compare to previous newsletters to detect trends - Store summaries in `~/clawd/memory/agresource/YYYY-MM-DD.md` (morning) - Store summaries in `~/clawd/memory/agresource/YYYY-MM-DD-noon.md` (noon) - Store summaries in `~/clawd/memory/agresource/YYYY-MM-DD-evening.md` (evening) - Store summaries in `~/clawd/memory/agresource/YYYY-MM-DD-saturday.md` (saturday) - Store summaries in `~/clawd/memory/agresource/YYYY-MM-DD-sunday.md` (sunday) - Track sentiment history in `~/clawd/memory/agresource/sentiment_history.json` - Send Telegram alerts on new sales advice ## Commands ### Manual Trigger ``` "Check AgResource newsletter" "Summarize today's grain report" "Show full newsletter" (detailed view) ``` **To run scraper manually:** ```bash cd /home/brianppetty/clawd/skills/agresource # Morning newsletter (default) node scraper.js node scraper.js --type=morning # Noon/midday newsletter node scraper.js --type=noon # Evening newsletter node scraper.js --type=evening # Saturday newsletter node scraper.js --type=saturday # Sunday newsletter node scraper.js --type=sunday ``` ### Cron Job Triggers When a cron event fires, match the time/type to the correct `--type` parameter: | Cron Message | Type to Use | Time | |--------------|-------------|------| | "Check AgResource newsletter (morning)" | `--type=morning` | 8:30 AM ET (Mon-Fri) | | "Check AgResource newsletter (afternoon)" | `--type=noon` | 1:30 PM ET (Mon-Fri) | | "Check AgResource newsletter (evening - positioning)" | `--type=evening` | 7:00 PM ET (Mon-Sat) | | "Check AgResource newsletter (weekend)" | `--type=saturday` or `--type=sunday` | ~3:00 PM ET (Sat/Sun) | **For weekend jobs**, determine which day it is and use: - Saturday: `--type=saturday` - Sunday: `--type=sunday` ### Sentiment Queries ``` "What's the current market sentiment?" "Show sentiment trends" "What's the sentiment history?" ``` ## Sentiment Dimensions (PRICE-IMPACT FOCUSED) **CRITICAL:** Sentiment analysis tracks PRICE IMPACT, not general "good/bad" news. **Key inverse relationships to remember:** - ☀️ Favorable weather in SA/NA = More supply = **BEARISH for prices** - 🌽 Record yields = More supply = **BEARISH for prices** - 🏜️ Drought/crop stress = Less supply = **BULLISH for prices** - 🏭 Strong export demand = More demand = **BULLISH for prices** - 📦 South American competition = Less US exports = **BEARISH for prices** Track these dimensions across newsletters: - **market_mood**: bullish | bearish | neutral - BULLISH = Prices expected to go UP - BEARISH = Prices expected to go DOWN - **weather_impact**: positive_for_crops | negative_for_crops | mixed | neutral - Tracks weather impact on PRODUCTION (inverted for price impact) - Positive weather for crops = BEARISH for prices (more supply) - Negative weather for crops = BULLISH for prices (less supply) - **production_outlook**: optimistic | cautious | uncertain - Optimistic = more supply = BEARISH for prices - Cautious = supply concerns = BULLISH for prices - **trend_direction**: improving | declining | stable - **confidence**: high | medium | low ## Sales Advice Detection **Status phrases to detect:** - "New sales advice detected" (buy/sell/recommend keywords) - "Catch up sales recommended" (catch up phrase) - "No sales recommended at this time" (hold/no action) - "Position status unchanged" (no change from previous) **Keywords for sales advice:** - buy, sell, hold, recommend, recommendation, position, catch up, current positioning ## Telegram Alert Format Brief summary sent for every newsletter: ``` 🌾 AgResource - 2026-01-08 8:30 AM Summary: No sales recommended Sentiment: Bullish (↗️ improving) Full details in ~/clawd/memory/agresource/ ``` ## Output Format ### Daily Summary File (`YYYY-MM-DD.md`) ```markdown # AgResource Newsletter - 2026-01-08 8:30 AM ## Quick Summary [2-3 sentence overview] ## Key Newsworthy Items - [Grain production relevant news] - [Weather tidbits] ## Sales Advice Status - Corn: [New sales advice / No change / No sales recommended] - Soybeans: [New sales advice / No change / No sales recommended] ## Current Positions (from end of newsletter) - [Summary of current positioning] ## Sentiment & Trends - **Market Mood:** Bullish / Bearish / Neutral - **Previous Mood:** [from last newsletter] - **Trend:** Improving / Declining / Stable - **Weather Impact:** Positive / Negative / Mixed - **Production Outlook:** Optimistic / Cautious / Uncertain ## Full Content [Optional: full newsletter content for reference] ``` ### Sentiment History File (`sentiment_history.json`) ```json { "last_updated": "2026-01-08T08:30:00", "sentiment_history": [ { "date": "2026-01-08", "time": "08:30 AM", "market_mood": "bullish", "weather_impact": "positive", "production_outlook": "optimistic", "trend_direction": "improving", "confidence": "high", "key_phrases": ["prices advancing", "favorable weather"], "sales_advice": "No sales recommended" } ] } ``` ## Configuration **Credentials:** Loaded from environment variables - `AGRESOURCE_EMAIL` - `AGRESOURCE_PASSWORD` **Dependencies:** - Node.js (built-in on Clawdbot) - Playwright (installed locally: `/home/brianppetty/clawd/skills/agresource/node_modules/playwright`) **Schedule:** 4x daily (cron jobs) - Morning: 8:30 AM ET - Afternoon: 1:30 PM ET - Evening: 7:00 PM ET - Weekend: ~3:00 PM ET **History window:** Keep last 15-20 newsletters for sentiment tracking ## Notes - Only send Telegram alerts when sales advice CHANGES - Always store summaries and sentiment data - Refine sentiment detection patterns over time - Evening newsletters include current positioning section - Login credentials should be handled securely