Panjiva Classification Pipeline Dashboard

Total Records

1.3M

Processed (2023-2025)

Classification Rate

62.9%

785,674 records

Tonnage Captured

71.3%

1.47 billion tons

Processing Time

~15 min

Per year dataset

📊 Classification Pipeline Flow

graph TB Start[Raw Panjiva Data
454K records 2023
449K records 2024
399K records 2025] --> Filter[PASS 1: Ship Spares Filter
33K filtered 2023
10K filtered 2024/2025] Filter --> P2[PHASE 2-3: Carrier Locks
RoRo + Reefer
AUTHORITATIVE - Never Override] P2 --> P4[PHASE 4-7: HS2 + Keywords
Aggregates, Lumber, Pulp, Paper, Rubber
HIGH CONFIDENCE 85-95%] P4 --> P8[PHASE 8: Combinatorial Rules
Chemical Tankers, Salt, Cement
Iron Ore, Steel, Machinery] P8 --> P9[PHASE 9: User Refinements
LBK Package 275M tons!
Manganese, Phosphate, Bauxite
Gasoline, Fuel Oil, Wind Components] P9 --> P10[PHASE 10: High-Value Commodities
Crude Oil Variants 79M tons!
Aluminum, LPG, Soybeans, HDF/MDF
15 commodity types added] P10 --> Result[FINAL RESULTS
2023: 80.2% classified
2024: 52.5% records 84.0% tonnage
2025: 55.9% records 82.8% tonnage] style Start fill:#e1f5ff style Filter fill:#fff4e6 style P2 fill:#d4edda style P4 fill:#d1ecf1 style P8 fill:#f8d7da style P9 fill:#d4edda style P10 fill:#fff3cd style Result fill:#c3e6cb

📈 3-Year Classification Progress

🎯 Tonnage Capture by Year

🏆 Phase 10 Top Commodities

💡 Key Discoveries

LBK Package Rule - The Hidden Gem

501M tons captured across 2024/2025 from single package type indicator. Accounts for ~50% of all classified tonnage!

Simplified Salt Rule

User's intuition: "salt is just salt" - Captured 32.9M tons total (13-19x more than specific variants)

Crude Oil Variants Discovery

Phase 10 added specific grade names (BASRAH, KIRKUK, HIBERNIA, PAYARA, LIZA, TUPI) = 79.1M tons

2025 Reefer Spike

Reefer cargo 5x increase in 2025 (7.6M tons vs 1.5M in 2023/2024) - Major trade shift detected

Aluminum Discovery

2024 had 4.3M tons of primary aluminum unclassified - likely Emirates Global Aluminium (EGA) shipments

🚢 Panjiva Classification Pipeline