Changelog

Data & Pipeline

• Monthly demand accuracy - Corrected May demand and gas figures: monthly demand is now aggregated from the daily materialized view instead of a stale monthly view, with a month-aligned backfill window (#548)
• Calendar gap-fill - Monthly and yearly series are now gap-filled onto the calendar grid, keeping market-value and weather coverage aligned (#548, #549)

Bug Fixes

• Status grouping - Fixed secondary_grouping=status returning a 500 on /v4/data/network/; data can now be grouped by facility status (operating, committed, retired) like the other secondary groupings (#539, #550)

Major Features

• Real-time WEM data - Western Australia generation and 5-minute dispatch pricing are now near-real-time via the new WEMDE dispatch-solution feed, replacing the previous ~24-hour lag (#527, #530, #533, #538)

Plans & Data Access

• Extended historical access for Community - Community plans can now query the last 2 years of data (previously 1 year). Academic and Enterprise plans retain full history back to 1999.
• Data licensing clarified - Plan comparisons now state usage terms: Community and Academic are licensed for non-commercial use; commercial use requires an Enterprise plan.

See Data Limits for the full breakdown.

API Improvements

• Accurate power aggregation - Power (MW) is now averaged across intervals instead of summed, fixing inflated figures at every grouping level (#523, #525)
• OpenAPI spec - Enriched with a generic response envelope, field metadata, and per-language code samples
• Capacity history - Now sums capacity_maximum with a fallback to registered capacity, fixing NULL WEM coal, gas and wind capacity (#528)

Data & Pipeline

• Gap-filled series - Chart series are reindexed onto the interval grid so upstream data gaps no longer misalign timestamps (#534, #535)

Bug Fixes

• WEM price aggregation - Confined to WEM with a hardened parser; locf() interpolation split into separate WEM and NEM columns (#541, #542)

Notifications

• Record debouncing - Interval milestone records are debounced to stop notification bursts, and battery-charging significance was lowered below the alert threshold to stop charging-driven alert floods

SDK Releases

Python client — openelectricity 0.11.2

• Proxy and custom TLS/certificate support on sync and async clients (#22, #29)
• New renewable-with-storage and gross-demand market metrics (#31)
• Notebook-safe sync client that works inside an existing event loop (Jupyter / IPython) (#16, #32)
• Restored Python 3.10+ support (#28); unit_code (#27) and network_region (#35) parity across sync and async

TypeScript client — openelectricity 0.9.1

• Full type parity with the Python SDK, adding the renewable_proportion metric and status secondary grouping (#12)
• Stronger error handling (403/404/500 surface as typed errors) (#18) and DataTable group-by and filter correctness fixes (#15, #19)

The 4.5.0 release moves the analytics pipeline to ClickHouse, rewrites interconnector flow tracing, and introduces a unified plan system for platform.

Major Features

• Flow Tracing v4 - Rewritten interconnector flow solver with a dynamic, ClickHouse-backed topology model that handles circular flows and per-flow emissions, exposed through the API and the homepage (#470)
• Automated weekly & monthly summaries - Generation and record summaries are now published automatically to X, Bluesky and LinkedIn behind a Slack approval workflow (#64)
• Renewable-with-storage metrics - New market metrics that account for storage when computing renewable proportion

API Improvements

• ClickHouse-backed stats - v4 station and facility stats endpoints restored and served from ClickHouse
• Facility endpoint - Added a unit_code filter, required authentication, and corrected no-data responses to 404 (previously 416)
• Cleaner /v4/me - Trimmed response and removed the dead with_clerk parameter from the OpenAPI spec

Data & Pipeline

• Postgres to ClickHouse - The analytics and export pipeline (power, energy, demand, flows) was migrated to ClickHouse and the legacy Postgres aggregation pipeline retired
• WEM demand - Derived from facility SCADA generation, since the public WEM feed provides price only
• Crawler improvements - AEMO sources moved to polling with backoff and parallelized crawls, with gap-aware catchup that skips redundant work
• Materialized views - Completeness-versioned daily and monthly views with full-day backfill and AEST-aligned refresh windows

Bug Fixes

• API key authentication - New API keys no longer return 401 across all endpoints (#487)
• Double-counting - ClickHouse FINAL scoping corrected to stop duplicate-row double-counting in market and price queries
• Energy calculation - Corrected the trapezoidal integration window and quality-flag handling; batteries excluded from generation queries
• Export boundaries - All series are truncated at the core generation boundary so demand, price and rooftop never extend past it
• RecordReactor - Moved to incremental milestone detection with automatic backfill of gaps

SDK Releases

Python client — openelectricity 0.10.1

• unit_code parameter on get_facility_data
• Flow market metrics; fueltech and status parameters now accept plain strings
• New bidirectional battery example

TypeScript client — openelectricity 0.8.1

• unitCodes parameter on getFacilityData
• Flow and renewable-with-storage market metrics, plus the hydro_and_storage fueltech
• getFacilities now throws NoDataFound on 404 (previously mishandled)

Major Features

• Renewable Energy Proportion Tracking - Real-time renewable energy percentage tracking across the network (#423)

  • New milestone type in RecordReactor for tracking renewable proportion
  • Significance scoring for renewable energy records
  • Exposed via API endpoints for programmatic access

• Max Generation Tracking - Historical peak generation capacity tracking per facility unit (#461)

  • New max_generation and max_generation_interval fields on facility units
  • Available via Facilities API endpoints

Infrastructure & Technology Upgrades

• Python 3.14 Support - Platform upgraded to Python 3.14 for improved performance and compatibility (#468)

  • Updated python-sanity dependency with async client and HTTP/2 support
  • Migrated from clickhouse-connect to clickhouse-http driver
  • Enhanced async patterns and event loop handling

• Unified HTTP Client - New rnet-based HTTP client replacing legacy libraries (#466, #467, #475)

  • Resolve crawl request errors with new rust-based HTTP client for all requests

• Granian ASGI Server - Application server upgraded from Hypercorn to Granian (#476)

  • Better resource utilization

API Improvements

• Facility API Enhancements - Expanded facility endpoint capabilities (#464)
  • Filter facilities by fueltech group
  • Unit datetime metadata fields synchronized from CMS
  • Timezone-aware datetime handling per network
  • Improved serialization excluding None values

Bug Fixes

• Curtailment Data Alignment - Fixed AEMO timestamp handling for curtailment data (#455)
• Interval Limits - Increased max interval days for better data coverage (#454)
• Data Storage - Fixed empty price data storage to prevent null records
• Market Summary - Fixed market summary refresh and column alignment
• Worker Stability - Catchup worker now runs all aggregates correctly
• Battery Mapping - Fixed battery unit mapping schema parsing issues
• Export Controller - Resolved ClickHouse query iteration and record processing
• API Responses - Fixed unset field handling by setting response_model_exclude_unset to false
• Logging - Reduced debug noise from httpcore and hpack, improved Logfire integration

Documentation

• Enhanced documentation for AEMO timestamp handling in curtailment data
• Updated API documentation with new endpoints and fields
• Infrastructure upgrade documentation and migration guides

Major Features

• Pollution Data (NPI) - Comprehensive pollution and emissions tracking from the National Pollutant Inventory now available across the platform (#436)

  • Track greenhouse gases, air pollutants, and heavy metals from power generation facilities
  • Details in documentation at the Pollution Guide
  • Access via API endpoints for programmatic integration
  • Example implementations:
    • Python client example
    • TypeScript client example

• Battery State of Charge - Real-time battery storage level tracking showing current energy stored in battery facilities (#434)

  • Monitor state of charge (SoC) at unit, facility, region and network levels
  • View battery storage docs in the Battery Storage Guide
  • New API endpoints for battery-specific data
  • Example implementations:
    • Python client example
    • TypeScript client example

• Facility API Improvements - Enhanced facility endpoint with additional fields (#453)

  • Added NPI ID field for pollution data mapping
  • Added location data for facilities

Improvements and Bug Fixes

• CPI Data Update - Consumer Price Index data import and tracking (#450)
• Curtailment Tracking - Renamed curtailment_solar to curtailment_solar_utility for clarity (#433)
• Battery Management - Improved battery unit handling and aggregation (#434)
• Record Tracking - Fixed duplicate records with identical rounded values (#451)
• Demand Energy - Demand energy now sourced from analytics table (#390)
• Unit Metadata - Cleaned out obsolete unit metadata for better data integrity

Documentation

• New comprehensive guides for pollution data and battery storage
• Updated API documentation with new endpoints
• Added code examples for accessing new features in Python and TypeScript clients

Major Features

• Curtailment Data - Comprehensive curtailment tracking for renewable energy generation now available across the platform (#433)
  • View curtailment data on the Open Electricity website
  • Access via API endpoints for programmatic integration
  • Full documentation available in the Curtailment Guide
  • Example implementations:
    • Python client example
    • TypeScript client example

Bug Fixes

• Historic Price Data - Fixed issues with historic price data retrieval and accuracy (#309)

Documentation

• New comprehensive guide on understanding curtailment data
• Updated API documentation with curtailment endpoints
• Added code examples for accessing curtailment data in Python and TypeScript clients

Major Features

• Capacity History Tracking - New comprehensive capacity history output that includes rooftop solar and applies unit history tracking (#415)
• CMS Integration - Import CMS IDs to database for facilities and units for better tracking
• APVI Capacity History - Controller to import APVI capacity history as unit histories (#432)
• Unit Histories - Enhanced unit histories with time axes for fields (#431)

Improvements

• Battery split static map improvements and bug fixes (#420)
• Rooftop capacity storage enhancements (#430)
• Decimal precision improvements in unit_history table (#431)
• Gap-fill improvements for rooftop capacity history (#415)

Bug Fixes

• Fixed WEM crawlers to include APVI month by default
• Resolved postcode prefix mapping (1 is NSW in APVI client)
• Fixed capacity chart task imports (#415)
• Corrected WEMDE trading price crawler length sanity checks
• Resolved issues with DRX facilities in first seen checks
• Fixed padding in query for rooftop capacities in capacity chart (#415)

Documentation

• Updated migration documentation for v4.1
• Enhanced API documentation

🎉 Platform Beta Launch

We’re excited to announce the beta launch of the Open Electricity Platform!

• Access at platform.openelectricity.org.au
• Sign up for early access and explore enhanced data analytics capabilities
• Advanced visualizations and custom data exports

SDK Releases

Python Client

• Official Open Electricity Python client library now available
• Install via pip: pip install openelectricity
• Full documentation and examples included

TypeScript Client

• Official Open Electricity TypeScript/JavaScript client library released
• Install via npm: npm install @opennem/client
• Type-safe API access with comprehensive type definitions

API Enhancements

• Performance Improvements - ORjson serialization on data and market endpoints for improved performance
• Milestones API - New milestones endpoints with optimized caching
• Record Reactor - Enhanced record reactor with Slack and Twitter alerts for significant events
• Solar Gap Filling - Improved solar 5-minute gap fill handling for APVI interval sizes

Social Integration

• Bluesky Client - Added Bluesky social media integration
• Twitter Client - Enhanced Twitter client for automated updates
• Record Alerts - Automatic social media alerts for significant generation records

Infrastructure

• API v3 deprecation notice (#424)
• Sanity CMS syncing to database rewrite (#422)
• Enhanced facility and unit integrity monitoring (#429)

Bug Fixes

• Fixed NEM interval check re-ordering and increased interval window
• Corrected battery charge/discharge significance scoring
• Resolved issues with regional demand calculations (#412)
• Fixed static historic records returning strings as data (#403)