Monitoring Forecasting Models at Scale

Photo by Volodymyr Hryshchenko on Unsplash

Monitoring Metrics

Forecast with small MAPE. Model forecast is very close to actual price movement.
Forecast with high R² and high MAPE. Model predicted the trend but not the price fluctuations.
Example of 2 time series matching using the DWT algorithm (Source: Wikipedia)

In action

An overview of aggregated performance statistics of a subset of models
Zooming in on VRSK model recent performance
Identifying individual forecasts based on a specific metric

What’s next

--

--

--

Stock & Cryptocurrency Forecasting AI. Based on News and Options Data. Powered by Intelligible Deep Learning models. https://predic.to

Love podcasts or audiobooks? Learn on the go with our new app.

Recommended from Medium

Decision Trees Explained

Icm Model Poker

Icm Model Poker

A tale of the two city

Social Media Analytics on Trump and Biden’s Twitter

How to Clean Zoom Transcript Data in a Pinch

ipyvizzu: A Fast Library to Build Charts’ Animations in Python

Hedge Fund Returns Replication

3D Interactive Data Visualization

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store
Predicto

Predicto

Stock & Cryptocurrency Forecasting AI. Based on News and Options Data. Powered by Intelligible Deep Learning models. https://predic.to

More from Medium

The AI & Analytics Engine vs. Amazon SageMaker Canvas

Will the Customer Pay Back the Loan? Using Feast to Analyze Credit Scoring Cases

How to Detect-le-Defect on Twitch

Time series analysis on AWS — Part 1 presentation — Forecasting