worldmonitor

KO | EN

gitlite — search

#javascript #python #go #machine-learning #rust #docker #macos #windows #awesome #kubernetes #vue #ios #mcp #open-source

(★ 54)

Real-time global intelligence dashboard — AI-powered news aggregation, geopolitical monitoring, and infrastructure tracking in a unified situational awareness interface.

worldmonitor Latest Version Download

Download Latest Version (.zip)

// repository documentation

Was this content helpful?

★ 0 (0 ratings)

# World Monitor

**Real-time global intelligence dashboard** — AI-powered news aggregation, geopolitical monitoring, and infrastructure tracking in a unified situational awareness interface.

[![GitHub stars](https://img.shields.io/github/stars/aDavidBravo/worldmonitor?style=social)](https://github.com/aDavidBravo/worldmonitor/stargazers)
[![GitHub forks](https://img.shields.io/github/forks/aDavidBravo/worldmonitor?style=social)](https://github.com/aDavidBravo/worldmonitor/network/members)
[![License: MIT](https://img.shields.io/badge/License-MIT-green.svg)](https://opensource.org/licenses/MIT)
[![TypeScript](https://img.shields.io/badge/TypeScript-007ACC?style=flat&logo=typescript&logoColor=white)](https://www.typescriptlang.org/)
[![Last commit](https://img.shields.io/github/last-commit/aDavidBravo/worldmonitor)](https://github.com/aDavidBravo/worldmonitor/commits/main)

<a href="./docs/DOCUMENTATION.md">Full Documentation</a> &nbsp;·&nbsp;
 <a href="https://github.com/aDavidBravo/worldmonitor/releases/latest">All Releases</a> &nbsp;·&nbsp;
 <a href="https://bravoaidatastudio.com">BravoAI Data Studio</a>

![World Monitor Dashboard](https://raw.githubusercontent.com/aDavidBravo/worldmonitor/main/new-world-monitor.png)

---

## My Contributions

This project is developed and maintained by **David Bravo** as part of the [BravoAI Data Studio](https://bravoaidatastudio.com) portfolio. Key contributions include:

| Area | Contribution |
|------|-------------|
| **Multi-variant architecture** | Designed and implemented the tri-variant system (World / Tech / Finance) from a single TypeScript codebase with build-time tree-shaking |
| **AI intelligence pipeline** | Hybrid threat classification (instant keyword + async LLM override), focal point detection, and Country Instability Index (CII) for 22 nations |
| **3D WebGL globe** | deck.gl + MapLibre rendering with 35+ toggleable data layers, smart clustering, zoom-adaptive opacity, and label deconfliction |
| **Temporal anomaly detection** | Welford's online algorithm for streaming baseline computation; z-score alerting per event type, weekday, and month over 90-day windows |
| **Desktop application** | Tauri 2 (Rust + Node.js sidecar) with OS keychain secret storage, per-session token auth, cloud fallback, and verbose debug mode |
| **OSINT data fusion** | Integration of 150+ RSS feeds, ACLED, GDELT, UCDP, OpenSky ADS-B, AISStream maritime, USGS, NASA FIRMS, Polymarket, and 15+ additional APIs |
| **Infrastructure cascade model** | Dependency graph (BFS depth ≤ 3) modeling how disruptions propagate through cables, pipelines, ports, and chokepoints |
| **Finance variant** | 92 stock exchanges, 19 financial centers, 13 central banks, 64 Gulf FDI investments mapped globally with sector/status filtering |
| **PWA + offline maps** | Service worker with CacheFirst tile strategy (500 tiles, 30-day TTL), auto-updating, installable on mobile and desktop |
| **Security hardening** | CORS origin allowlist, RSS domain allowlist, server-side API key isolation, input sanitization, Redis-backed IP rate limiting |

---

## Why World Monitor?

| Problem | Solution |
|---------|----------|
| News scattered across 100+ sources | **Single unified dashboard** with 150+ curated feeds |
| No geospatial context for events | **Interactive map** with 35+ toggleable data layers |
| Information overload | **AI-synthesized briefs** with focal point detection |
| Crypto/macro signal noise | **7-signal market radar** with composite BUY/CASH verdict |
| Expensive OSINT tools ($$$) | **100% free & open source** |
| Static news feeds | **Real-time updates** with live video streams |
| Web-only dashboards | **Native desktop app** (Tauri) + installable PWA with offline map support |
| Flat 2D maps | **3D WebGL globe** with deck.gl rendering and 35+ toggleable data layers |
| Siloed financial data | **Finance variant** with 92 stock exchanges, 19 financial centers, 13 central banks, and Gulf FDI tracking |

---

## Live Demos

| Variant | URL | Focus |
|---------|-----|-------|
| **World Monitor** | [worldmonitor.app](https://worldmonitor.app) | Geopolitics, military, conflicts, infrastructure |
| **Tech Monitor** | [tech.worldmonitor.app](https://tech.worldmonitor.app) | Startups, AI/ML, cloud, cybersecurity |
| **Finance Monitor** | [finance.worldmonitor.app](https://finance.worldmonitor.app) | Global markets, trading, central banks, Gulf FDI |

All three variants run from a single codebase — switch between them with one click via the header bar (🌍 WORLD | 💻 TECH | 📈 FINANCE).

---

## Key Features

### Localization & Regional Support

- **Multilingual UI** — Fully localized interface supporting **English, French, Spanish, German, Italian, Portuguese, Dutch, Swedish, Russian, Arabic, Chinese, and Japanese**.
- **RTL Support** — Native right-to-left layout support for Arabic (`ar`) and Hebrew.
- **Localized News Feeds** — Region-specific RSS selection based on language preference (e.g., viewing the app in French loads Le Monde, Jeune Afrique, and France24).
- **AI Translation** — Integrated LLM translation for news headlines and summaries, enabling cross-language intelligence gathering.
- **Regional Intelligence** — Dedicated monitoring panels for Africa, Latin America, Middle East, and Asia with local sources.

### Interactive 3D Globe

- **WebGL-accelerated rendering** — deck.gl + MapLibre GL JS for smooth 60fps performance with thousands of concurrent markers. Switchable between **3D globe** (with pitch/rotation) and **flat map** mode via `VITE_MAP_INTERACTION_MODE`
- **35+ data layers** — conflicts, military bases, nuclear facilities, undersea cables, pipelines, satellite fire detection, protests, natural disasters, datacenters, displacement flows, climate anomalies, cyber threat IOCs, stock exchanges, financial centers, central banks, commodity hubs, Gulf investments, and more
- **Smart clustering** — Supercluster groups markers at low zoom, expands on zoom in. Cluster thresholds adapt to zoom level
- **Progressive disclosure** — detail layers (bases, nuclear, datacenters) appear only when zoomed in; zoom-adaptive opacity fades markers from 0.2 at world view to 1.0 at street level
- **Label deconfliction** — overlapping labels (e.g., multiple BREAKING badges) are automatically suppressed by priority, highest-severity first
- **8 regional presets** — Global, Americas, Europe, MENA, Asia, Africa, Oceania, Latin America
- **Time filtering** — 1h, 6h, 24h, 48h, 7d event windows
- **URL state sharing** — map center, zoom, active layers, and time range are encoded in the URL for shareable views (`?view=mena&zoom=4&layers=conflicts,bases`)

### AI-Powered Intelligence

- **World Brief** — LLM-synthesized summary of top global developments (Groq Llama 3.1, Redis-cached)
- **Hybrid Threat Classification** — instant keyword classifier with async LLM override for higher-confidence results
- **Focal Point Detection** — correlates entities across news, military activity, protests, outages, and markets to identify convergence
- **Country Instability Index** — real-time stability scores for 22 monitored nations using weighted multi-signal blend
- **Trending Keyword Spike Detection** — 2-hour rolling window vs 7-day baseline flags surging terms across RSS feeds, with CVE/APT entity extraction and auto-summarization
- **Strategic Posture Assessment** — composite risk score combining all intelligence modules with trend detection
- **Country Brief Pages** — click any country for a full-page intelligence dossier with CII score ring, AI-generated analysis, top news with citation anchoring, prediction markets, 7-day event timeline, active signal chips, infrastructure exposure, and stock market index — exportable as JSON, CSV, or image

### Real-Time Data Layers

<details>
<summary>Geopolitical</summary>

- Active conflict zones with escalation tracking (UCDP + ACLED)
- Intelligence hotspots with news correlation
- Social unrest events (dual-source: ACLED protests + GDELT geo-events, Haversine-deduplicated)
- Natural disasters from 3 sources (USGS earthquakes M4.5+, GDACS alerts, NASA EONET events)
- Sanctions regimes
- Cyber threat IOCs (C2 servers, malware hosts, phishing, malicious URLs) geo-located on the globe
- Weather alerts and severe conditions

</details>

<details>
<summary>Military & Strategic</summary>

- 220+ military bases from 9 operators
- Live military flight tracking (ADS-B)
- Naval vessel monitoring (AIS)
- Nuclear facilities & gamma irradiators
- APT cyber threat actor attribution
- Spaceports & launch facilities

</details>

<details>
<summary>Infrastructure</summary>

- Undersea cables with landing points
- Oil & gas pipelines
- AI datacenters (111 major clusters)
- 83 strategic ports across 6 types (container, oil, LNG, naval, mixed, bulk) with throughput rankings
- Internet outages (Cloudflare Radar)
- Critical mineral deposits
- NASA FIRMS satellite fire detection (VIIRS thermal hotspots)

</details>

<details>
<summary>Market & Crypto Intelligence</summary>

- 7-signal macro radar with composite BUY/CASH verdict
- BTC spot ETF flow tracker (IBIT, FBTC, GBTC, and 7 more)
- Stablecoin peg health monitor (USDT, USDC, DAI, FDUSD, USDe)
- Fear & Greed Index with 30-day history
- Bitcoin technical trend (SMA50, SMA200, VWAP, Mayer Multiple)
- JPY liquidity signal, QQQ/XLP macro regime, BTC hash rate
- Inline SVG sparklines and donut gauges for visual trends

</details>

<details>
<summary>Tech Ecosystem (Tech variant)</summary>

- Tech company HQs (Big Tech, unicorns, public)
- Startup hubs with funding data
- Cloud regions (AWS, Azure, GCP)
- Accelerators (YC, Techstars, 500)
- Upcoming tech conferences

</details>

<details>
<summary>Finance & Markets (Finance variant)</summary>

- 92 global stock exchanges — mega (NYSE, NASDAQ, Shanghai, Euronext, Tokyo), major (Hong Kong, London, NSE/BSE, Toronto, Korea, Saudi Tadawul), and emerging markets — with market caps and trading hours
- 19 financial centers — ranked by Global Financial Centres Index
- 13 central banks — Federal Reserve, ECB, BoJ, BoE, PBoC, SNB, RBA, BoC, RBI, BoK, BCB, SAMA, plus supranational institutions (BIS, IMF)
- 10 commodity hubs — exchanges (CME Group, ICE, LME, SHFE, DCE, TOCOM, DGCX, MCX) and physical hubs (Rotterdam, Houston)
- Gulf FDI investment layer — 64 Saudi/UAE foreign direct investments plotted globally, color-coded by status (operational, under-construction, announced), sized by investment amount

</details>

### Live News & Video

- **150+ RSS feeds** across geopolitics, defense, energy, tech, and finance — domain-allowlisted proxy prevents CORS issues
- **8 live video streams** — Bloomberg, Sky News, Al Jazeera, Euronews, DW, France24, CNBC, Al Arabiya — with automatic live detection
- **Desktop embed bridge** — YouTube's IFrame API restricts playback in native webviews; the dashboard detects this and transparently routes through a cloud-hosted embed proxy
- **Idle-aware playback** — video players pause and are removed from the DOM after 5 minutes of inactivity
- **Custom monitors** — Create keyword-based alerts for any topic, color-coded with persistent storage
- **Entity extraction** — Auto-links countries, leaders, organizations
- **Virtual scrolling** — news panels render only visible DOM elements, handling thousands of items without browser lag

### Signal Aggregation & Anomaly Detection

- **Multi-source signal fusion** — internet outages, military flights, naval vessels, protests, AIS disruptions, satellite fires, and keyword spikes aggregated into a unified intelligence picture
- **Temporal baseline anomaly detection** — Welford's online algorithm computes streaming mean/variance per event type, region, weekday, and month over a 90-day window. Z-score thresholds (1.5/2.0/3.0) flag deviations
- **Regional convergence scoring** — when multiple signal types spike in the same geographic area, the system identifies convergence zones and escalates severity

### Desktop Application (Tauri)

- **Native desktop app** for macOS and Windows — packages the full dashboard with a local Node.js sidecar that runs all 60+ API handlers locally
- **OS keychain integration** — API keys stored in the system credential manager (macOS Keychain, Windows Credential Manager), never in plaintext files
- **Token-authenticated sidecar** — a unique session token prevents other local processes from accessing the sidecar on localhost
- **Cloud fallback** — when a local API handler fails, requests transparently fall through to the cloud deployment
- **Settings window** — dedicated configuration UI (Cmd+,) for managing 17 API keys

### Progressive Web App

- **Installable** — can be installed to the home screen on mobile or as a standalone desktop app
- **Offline map support** — MapTiler tiles are cached using a CacheFirst strategy (500 tiles, 30-day TTL)
- **Smart caching strategies** — APIs and RSS feeds use NetworkOnly; fonts (1-year TTL), images (7-day StaleWhileRevalidate), and static assets (1-year immutable) are aggressively cached
- **Auto-updating service worker** — checks for new versions every 60 minutes

---

## How It Works

### Country Brief Pages

Clicking any country on the map opens a full-page intelligence dossier. The brief is organized into a two-column layout:

**Left column**: Instability Index (animated SVG score ring), Intelligence Brief (AI-generated with inline citation anchors), Top News (8 headlines, threat-level color-coded)

**Right column**: Active Signals, 7-Day Timeline (D3.js), Prediction Markets, Infrastructure Exposure

### Country Instability Index (CII)

22 tier-1 countries receive continuous monitoring: US, Russia, China, Ukraine, Iran, Israel, Taiwan, North Korea, Saudi Arabia, Turkey, Poland, Germany, France, UK, India, Pakistan, Syria, Yemen, Myanmar, Venezuela, Brazil, and UAE.

| Component | Weight | Details |
|-----------|--------|---------|
| **Baseline risk** | 40% | Pre-configured per country reflecting structural fragility |
| **Unrest events** | 20% | Protests scored logarithmically for democracies, linearly for authoritarian states |
| **Security activity** | 20% | Military flights (3pts) + vessels (5pts), foreign military presence doubled |
| **Information velocity** | 20% | News mention frequency weighted by event severity, log-scaled |

### Threat Classification Pipeline

Every news item passes through a two-stage pipeline:

1. **Keyword classifier** (instant) — pattern-matches against ~120 threat keywords organized by severity tier
2. **LLM classifier** (async) — Groq Llama 3.1 8B at temperature 0, Redis-cached 24h by headline hash. Overrides keyword result only when higher-confidence

### Temporal Baseline Anomaly Detection

Uses **Welford's online method** for numerically stable streaming computation of mean and variance, stored in Redis with a 90-day rolling window.

| Z-Score | Severity | Example |
|---------|----------|---------|
| ≥ 1.5 | Low | Slightly elevated protest activity |
| ≥ 2.0 | Medium | Unusual naval presence |
| ≥ 3.0 | High/Critical | Military flights 3x above baseline |

### Infrastructure Cascade Modeling

A dependency graph connects undersea cables, pipelines, ports, chokepoints, and countries. When a disruption occurs, BFS propagation (depth ≤ 3) computes cascading impact:

```
Impact = edge_weight × disruption_level × (1 − redundancy)
```

Strategic chokepoint modeling captures real-world energy dependencies (Strait of Hormuz, Suez Canal, Malacca Strait).

### Geographic Convergence Detection

Events are binned into 1°×1° geographic cells within a 24-hour window. When 3+ distinct event types converge in one cell, a convergence alert fires. Scoring: ×25pts per unique type + event count bonuses.

### Browser-Side ML Pipeline

Via Transformers.js, no server dependency for core intelligence:

| Capability | Model | Use |
|-----------|-------|-----|
| **Text embeddings** | sentence-similarity | Semantic clustering of news headlines |
| **Sequence classification** | threat-classifier | Threat severity and category detection |
| **Summarization** | T5-small | Fallback when Groq and OpenRouter are unavailable |
| **Named Entity Recognition** | NER pipeline | Country, organization, and leader extraction |

---

## Architecture

### Tri-Variant System

| Aspect | World Monitor | Tech Monitor | Finance Monitor |
|--------|--------------|--------------|-----------------|
| **Focus** | Geopolitics, military, conflicts | AI/ML, startups, cybersecurity | Markets, trading, central banks |
| **RSS Feeds** | ~25 categories | ~20 categories | ~18 categories |
| **Unique Map Layers** | Military bases, nuclear, hotspots | Tech HQs, cloud regions, hubs | Stock exchanges, central banks, Gulf FDI |

### Multi-Platform Deployment

```
┌─────────────────────────────────────┐
│          Vercel (Edge)              │
│  60+ edge functions · static SPA   │
│  CORS allowlist · Redis cache       │
└──────────┬─────────────┬────────────┘
           │             │ fallback
           │             ▼
           │  ┌───────────────────────────────────┐
           │  │     Tauri Desktop (Rust + Node)    │
           │  │  OS keychain · Token-auth sidecar  │
           │  └───────────────────────────────────┘
           │
           ▼
┌─────────────────────────────────────┐
│       Railway (Relay Server)        │
│  WebSocket relay · OpenSky OAuth2   │
│  RSS proxy for blocked domains      │
└─────────────────────────────────────┘
```

### Architecture Principles

| Principle | Implementation |
|-----------|---------------|
| **Speed over perfection** | Keyword classifier is instant; LLM refines asynchronously |
| **Assume failure** | Per-feed circuit breakers with 5-minute cooldowns. AI fallback chain: Groq → OpenRouter → browser-side T5 |
| **Show what you can't see** | Intelligence gap tracker explicitly reports data source outages |
| **Browser-first compute** | Analysis runs client-side — no backend compute dependency for core intelligence |
| **Multi-signal correlation** | No single data source trusted alone. Focal points require convergence across news + military + markets + protests |
| **Cache everything, trust nothing** | Three-tier caching (in-memory → Redis → upstream) with versioned cache keys and stale-on-error fallback |

---

## Tech Stack

| Category | Technologies |
|----------|--------------|
| **Frontend** | TypeScript, Vite, deck.gl (WebGL 3D globe), MapLibre GL, vite-plugin-pwa |
| **Desktop** | Tauri 2 (Rust) with Node.js sidecar, OS keychain integration (keyring crate), native TLS (reqwest) |
| **AI/ML** | Groq (Llama 3.1 8B), OpenRouter (fallback), Transformers.js (browser-side T5, NER, embeddings) |
| **Caching** | Redis (Upstash) — 3-tier cache; Vercel CDN (s-maxage); Service worker (Workbox) |
| **Geopolitical APIs** | OpenSky, GDELT, ACLED, UCDP, HAPI, USGS, GDACS, NASA EONET, NASA FIRMS, Polymarket, Cloudflare Radar, WorldPop |
| **Market APIs** | Yahoo Finance, CoinGecko, mempool.space, alternative.me |
| **Threat Intel APIs** | abuse.ch (Feodo Tracker, URLhaus), AlienVault OTX, AbuseIPDB, C2IntelFeeds |
| **Deployment** | Vercel Edge Functions (60+ endpoints) + Railway (WebSocket relay) + Tauri (desktop) + PWA |
| **Data** | 150+ RSS feeds, ADS-B transponders, AIS maritime data, VIIRS satellite imagery, 8 live YouTube streams |

---

## Quick Start

```bash
git clone https://github.com/aDavidBravo/worldmonitor.git
cd worldmonitor
npm install
vercel dev       # Runs frontend + all 60+ API edge functions
```

Open [http://localhost:3000](http://localhost:3000)

> **Note**: `vercel dev` requires the [Vercel CLI](https://vercel.com/docs/cli) (`npm i -g vercel`). If you use `npm run dev` instead, only the frontend starts — news feeds and API-dependent panels won't load.

### Environment Variables (Optional)

```bash
cp .env.example .env.local
```

| Group | Variables | Free Tier |
|-------|-----------|-----------|
| **AI** | `GROQ_API_KEY`, `OPENROUTER_API_KEY` | 14,400 req/day (Groq) |
| **Cache** | `UPSTASH_REDIS_REST_URL`, `UPSTASH_REDIS_REST_TOKEN` | 10K commands/day |
| **Markets** | `FINNHUB_API_KEY`, `FRED_API_KEY`, `EIA_API_KEY` | All free tier |
| **Tracking** | `WINGBITS_API_KEY`, `AISSTREAM_API_KEY` | Free |
| **Geopolitical** | `ACLED_ACCESS_TOKEN`, `CLOUDFLARE_API_TOKEN`, `NASA_FIRMS_API_KEY` | Free for researchers |
| **UI** | `VITE_VARIANT`, `VITE_MAP_INTERACTION_MODE` (`flat` or `3d`, default `3d`) | N/A |

---

## Self-Hosting

### Option 1: Deploy to Vercel (Recommended)

```bash
npm install -g vercel
vercel
```

Add API keys in the Vercel dashboard under **Settings → Environment Variables**.

### Option 2: Local Development

```bash
npm install -g vercel
cp .env.example .env.local
vercel dev
```

### Option 3: Static Frontend Only

```bash
npm run dev    # Vite dev server — map and client-side features only
```

---

## Development Commands

```bash
# Development
npm run dev          # Full variant
npm run dev:tech     # Tech variant
npm run dev:finance  # Finance variant

# Production builds
npm run build:full
npm run build:tech
npm run build:finance

# Quality
npm run typecheck

# Desktop packaging
npm run desktop:package:macos:full
npm run desktop:package:windows:full
```

---

## Roadmap

- [x] 60+ API edge functions
- [x] Tri-variant system (geopolitical + tech + finance)
- [x] Market intelligence (macro signals, ETF flows, stablecoin monitoring)
- [x] Native desktop app (Tauri) with OS keychain + authenticated sidecar
- [x] Progressive Web App with offline map support
- [x] 3D WebGL globe (deck.gl)
- [x] Country brief pages with AI-generated intelligence dossiers
- [x] Cyber threat intelligence layer
- [x] Trending keyword spike detection with baseline anomaly alerting
- [x] Finance variant — 92 stock exchanges, Gulf FDI database
- [x] AIS maritime chokepoint detection and vessel density grid
- [x] Panel height resizing with persistent layout state
- [ ] Mobile-optimized views
- [ ] Push notifications for critical alerts
- [ ] Self-hosted Docker image

---

## License

MIT License — see [LICENSE](LICENSE) for details.

---

## Author

**David Bravo** — [GitHub](https://github.com/aDavidBravo) · [BravoAI Data Studio](https://bravoaidatastudio.com)

Data Engineer & AI/ML Developer specializing in real-time data pipelines, geospatial intelligence, and full-stack analytics platforms.

---

<a href="https://worldmonitor.app">worldmonitor.app</a> &nbsp;·&nbsp;
 <a href="https://tech.worldmonitor.app">tech.worldmonitor.app</a> &nbsp;·&nbsp;
 <a href="https://finance.worldmonitor.app">finance.worldmonitor.app</a> &nbsp;·&nbsp;
 <a href="https://bravoaidatastudio.com">bravoaidatastudio.com</a>

## Star History

worldmonitor

worldmonitor Latest Version Download

Today's picks

Was this content helpful?

Recent Feedback

worldmonitor

worldmonitor Latest Version Download

Today's picks

Was this content helpful?

Recent Feedback

Download README