Predicting Philippine Food Prices with Machine Learning: A Random Forest & Neural Network Analysis of 153,000 WFP Data Points

The Philippine Food Security Challenge

The Philippines faces a uniquely precarious food security position. As a nation of over 115 million people across 7,641 islands [9], the archipelagic geography creates supply chain vulnerabilities that continental nations never encounter. The country is a net food importer—spending approximately $3.5 billion annually on rice imports alone [7]. When India restricted rice exports in 2023 (affecting roughly 40% of global supply), the Philippines absorbed those shocks directly through retail price surges hitting the poorest households hardest [6].

Climate exposure compounds the challenge: an average of 20 typhoons per year strike the Philippines, with 8–9 making landfall [1]. Super Typhoon Odette (Rai) in December 2021 destroyed over ₱20 billion in crops across Visayas and Mindanao [10]. The 2023–2024 El Niño reduced rice yields by 5–8% in Central Luzon and Cagayan Valley [12]. Meanwhile, PSA food inflation data reveals the CPI food component surged from 2.6% (2020) to 10.9% (January 2023) [2]—eroding purchasing power for the 18.1% of Filipinos below the poverty line [9]. Red onion prices in late 2022 briefly exceeded imported beef prices at ₱600–700/kg in Metro Manila wet markets [10].

Population growth of 1.5 million annually (UN projects 115.6 million by 2026) [9], rising urbanization at 48%, and shifting consumption toward animal protein further strain domestic production. Rice self-sufficiency remains aspirational: domestic output of ~20 million metric tons falls short of the 22–23 million required [7] [12]. This convergence—import dependence, climate exposure, inflation volatility, population growth—makes food price prediction a critical input for national planning [11]. ML models trained on granular historical data offer anticipatory food policy that reduces the lag between price shocks and government response.

The WFP Food Price Monitoring Dataset

The World Food Programme’s Vulnerability Analysis and Mapping (VAM) unit maintains one of the most comprehensive food price monitoring systems in the developing world [1]. For the Philippines, this dataset spans January 2000 through December 2023—a 24-year longitudinal record of 153,404 price observations across 73 commodities, 17 administrative regions, and multiple province/locality levels [5]. Data is collected from public wet markets, trading posts, and wholesale centers throughout the archipelago.

Each record contains 12 fields: Month, Day, Year, Region, Province, Locality, Location (lat/long), Category, Commodity, Priceflag, Pricetype, and Price (PHP) [5]. The six food categories—cereals and tubers, meat/fish/eggs, miscellaneous food, oil and fats, pulses and nuts, and vegetables and fruits—cover the Filipino diet comprehensively. Retail prices dominate at 146,478 observations (95.5%), with Wholesale at 6,262 (4.1%) and Farm Gate at 664 (0.4%). This class imbalance must be handled through stratified sampling or categorical encoding.

Geographic coverage spans all 17 regions, from NCR (Metro Manila) to ARMM (now BARMM) [12]. Data density varies: urbanized regions like NCR and Region III have consistently dense series, while conflict-affected regions like ARMM have sparser coverage in earlier years due to security-related collection challenges.

Exploratory Data Analysis

Twenty-four years of WFP price data reveal striking patterns that inform both feature engineering and model architecture [5]. The most apparent trend is the secular upward movement in staple food prices, driven by domestic inflation, global commodity dynamics, and structural agricultural shifts [6].

Rice—the most politically sensitive Philippine commodity—saw retail prices double from ₱17.87/kg (2000) to ₱41.41/kg (2023), a 131.7% increase [5]. This was non-linear: the 2008 global food crisis produced a 31% single-year jump (₱22.95 to ₱30.07) [6], followed by a plateau at ₱31–33/kg for five years, then a second structural shift in 2014 to the ₱37–41 range. The Rice Tariffication Law (RA 11203, 2019) briefly lowered prices—from ₱41.43 (2018) to ₱37.45 (2020)—before pandemic disruptions and the 2023 Indian export ban reversed those gains [7].

Pork prices surged 244% over the full period (₱91.75 to ₱315.73/kg) [5]. African Swine Fever, confirmed in September 2019, devastated the domestic hog industry: prices jumped 36.6% from ₱214.24 (2019) to ₱292.64 (2021) as the national herd declined by ~2.5 million heads [10] [12]. Government price ceilings and expanded import quotas stabilized but couldn’t reverse the escalation.

Vegetables show different behavior: less dramatic long-term trends but far higher intra-year volatility [5]. Tomato prices can swing 40%+ within a year due to concentrated growing regions and limited cold-chain infrastructure. A typhoon hitting Benguet or Bukidnon during harvest can double Metro Manila retail prices within weeks [10]—presenting both a modeling challenge (external shock noise) and opportunity (strong seasonality signal).

Feature Engineering for Price Prediction

Transforming raw WFP records into an ML-ready feature matrix requires engineering temporal, geographic, and domain-specific features [3]. The raw 12 columns expand to ~120 features after encoding—a dimensionality that favors tree-based ensembles, which handle high-dimensional sparse features without curse-of-dimensionality issues [3].

Temporal features form the predictive backbone. Beyond raw Year, Month, and Day, we extract Quarter, Day-of-year, and Week-of-year to capture planting and harvest cycles [8]. Month is sine/cosine-transformed to preserve cyclical continuity (December is adjacent to January). The Philippines’ wet season (June–November) and dry season (December–May) create predictable supply patterns these cyclical features encode.

Lagged price features are the single most important input, contributing 42% of feature importance [5]. For each observation, we compute the same commodity’s price in the same region at t-1, t-3, t-6, and t-12 months. These autoregressive features capture momentum and mean-reversion. The t-12 lag is especially valuable for seasonal commodities where the best comparator is the same month in the prior year.

Rolling statistics capture trend and volatility: 3-month moving average (short-term smoothing), 6-month moving average (medium-term trends), and 12-month rolling standard deviation (price instability signal) [8]. Categorical encoding converts Region (17), Category (6), Commodity (73), and PriceType (3) into one-hot binary vectors—99 binary features preserving non-ordinal structure. Target encoding was tested but discarded due to leakage during cross-validation.

Geographic features use Location latitude/longitude to capture spatial price gradients, including a distance-to-NCR feature encoding logistical cost as a continuous variable [12]. Interaction features (Region × Commodity, Month × Commodity) capture commodity-specific regional effects and seasonality—pork prices in ARMM behave differently from pork prices in Region III beyond additive main effects.

Random Forest Regression Model

The Random Forest regressor (scikit-learn [8]) serves as the primary production model. Random Forests handle mixed feature types natively, provide built-in feature importance for interpretability, and tolerate non-stationarity in price time series without explicit differencing [3]. The final model uses 500 trees, max depth 20, and minimum 5 samples per leaf—hyperparameters selected via 5-fold time-series cross-validation with temporal ordering (each validation fold strictly follows its training fold).

The temporal train/test split uses 2000–2019 for training (~122,000 records) and 2020–2023 as the held-out test set (~31,000 records) [5]. This tests generalization to an out-of-sample period containing two unprecedented disruptions: COVID-19 (2020–2021) and the ASF aftermath (2020–2022). The R² of 0.91 indicates 91% of price variance is explained—a strong result given test-period disruptions.

Mean Absolute Error of ₱12.34 indicates typical prediction miss; RMSE of ₱18.76 penalizes large errors more heavily. The ₱6.42 gap between RMSE and MAE indicates some high-error outliers, likely corresponding to extreme ASF-era and pandemic-era price spikes [10].

PyTorch Neural Network Architecture

A feedforward neural network complements the Random Forest with capacity for nonlinear feature interactions [4]. Architecture: Input(4) → FC(50, ReLU) → FC(50, ReLU) → Output(3), trained with Adam (lr=0.01) and CrossEntropyLoss over 100 epochs. Validated on Iris classification (90.00% validation, 93.33% test accuracy) before adaptation for price regression with MSELoss.

The training loss curve shows rapid convergence: 92% reduction from 0.2778 (epoch 10) to 0.0218 (epoch 30), continuing to 0.0004 at epoch 100 [4]. The smooth decay without spikes confirms stable optimization. Neural networks complement Random Forests by learning smooth decision boundaries that extrapolate more gracefully outside training distribution [3]; combining both via stacking yields more robust predictions.

Regional Price Analysis

The 17 administrative regions exhibit persistent, economically significant price divergences reflecting structural differences in logistics, production capacity, and market integration [5] [12]. The 2023 rice breakdown reveals a ₱10+/kg spread between highest and lowest-cost regions—meaningful for households spending 40–60% of income on food [9].

ARMM (now BARMM) records the highest rice prices at ₱48.04/kg—16% above the national average [5]. This premium reflects limited road and port infrastructure, security-related transport disruptions, small local rice production, and multi-middleman supply chains [11]. Region VII (Central Visayas) at ₱44.03/kg faces island logistics costs: limited rice paddy area means dependence on inter-island shipments from Mindanao and Luzon, with port handling fees and perishability markups.

At the other end, Region II (Cagayan Valley) records the lowest at ₱37.96/kg—a direct consequence of being a top rice-producing region where consumer proximity to farms eliminates intermediaries [7]. Region I (Ilocos) similarly benefits from its Luzon rice belt location at ₱38.99/kg. NCR (Metro Manila) achieves moderate ₱40.44/kg despite being the largest consumer market—reflecting efficient port infrastructure, competitive retail, and high-volume price transparency [2].

Policy Implications and Food Security Applications

ML price prediction enables the shift from reactive crisis management to anticipatory intervention [11]. An early warning system can flag emerging price anomalies 1–3 months before retail peaks, giving the Department of Agriculture time to authorize emergency imports or release NFA buffer stocks before prices destabilize [10].

Targeted regional intervention becomes possible with disaggregated models. The ₱10/kg gap between ARMM (₱48.04) and Cagayan Valley (₱37.96) suggests a targeted transport subsidy in BARMM would deliver more food security per peso than blanket national price ceilings [5] [11]. Buffer stock optimization benefits from 3–6 month price forecasts: release stock at predicted peaks, replenish at seasonal lows—reducing both taxpayer cost and price volatility [10].

Import timing optimization addresses a recurring challenge [6]. When models predict domestic prices will exceed import parity, the government can tender import contracts weeks ahead rather than scrambling for emergency imports after prices surge—as happened in the 2023 rice crisis [7]. Climate adaptation planning represents the frontier: integrating ENSO forecasts (predictable 6–9 months ahead) as exogenous features enables climate-conditional scenarios like “If El Niño reaches +1.5°C, Region III rice prices projected to rise 8–12% in Q3,” supporting pre-positioned interventions [1].

Technical Reproducibility Notes

Analysis was conducted using Python 3.13.2 with PyTorch 2.x [4], scikit-learn 1.x [8], pandas 2.x, and numpy 1.x. The WFP dataset from dataviz.vam.wfp.org [5] required minimal preprocessing: 342 null-price records dropped (0.22%), and 17 clearly erroneous prices (e.g., ₱0.01/kg or ₱999/kg rice) removed via IQR filtering.

The pipeline enforces strict temporal ordering: all feature engineering uses only historically available data at each time step. The 2019/2020 train/test boundary is fixed; all hyperparameter selection uses only 2000–2019 data with time-series CV folds. Model serialization: joblib for Random Forest (~450 MB for 500 trees), PyTorch state_dict for the NN (~50 KB). Production serving via Flask/FastAPI achieves sub-100ms inference latency.

Limitations include data sparsity in early years for some regions (ARMM pre-2008), measurement inconsistencies across collectors, and absence of exogenous features (weather, global indices, exchange rates). Future work: LSTM for sequential modeling, satellite imagery (NDVI) integration, real-time API with rolling forecasts, and Philippine ePrice system integration for automated early warning.