Hybrid News Sentiment Engine: Real-Time Market Analysis via Adaptive Ensemble Learning on News-Price Pairs

We present a hybrid news sentiment engine that continuously learns market sentiment from paired news headlines and concurrent asset-price snapshots without requiring any neural network training or GPU compute. The system uses a three-way ensemble combining (1) a financial-domain lexicon (FinBERT-style keyword scoring), (2) an adaptive statistical TF-IDF cluster learner that organizes headlines into semantic neighborhoods and tracks their average realized price reactions, and (3) an auto-calibrating weighting mechanism that adjusts ensemble contributions based on each signal’s historical correlation with actual price movements. The engine runs on a 3-hour polling cycle from the Tradeflags NewsFeed API, which provides 22 price-snapshot fields per news item spanning equity indices (ES, NQ, SPY, DJIA, NDX, IWM), commodities (CL), and cryptocurrencies (BTC, ETH). All processing occurs at sub-second latency on a CPU-only server at effectively zero marginal cost per analytic cycle. We compare our approach against established methods – FinBERT, GPT-based scoring, VADER, and commercial sentiment APIs – across dimensions of cost, latency, accuracy, and adaptability. Our statistical cluster learner, which adapts to changing market regimes without retraining, represents a novel contribution not found in existing sentiment systems.