Measure Effect & Insights - Delays in Receiving Data

Incident Report for Flixmedia

Resolved

Morning All,

We are pleased to report that the data reconciliation is complete with all missing data now available in the Measure Effect & Insights platform.
We have performed all relevant checks and QA in the system and can confirm that all dashboards are now up to date.

The data and incident management team will work with Limelight (our 3rd Party Provider) to carry out a full post mortem on this issue to understand lessons learned and how we can improve moving forward.

If you have any questions or queries regarding this incident, please reach out to me directly.

For more information, please refer to the following document:
https://advsmo-my.sharepoint.com/:b:/g/personal/aravind_flixmedia_tv/EVNTMV-WqQtPiqzzg5m-9EkB3ruzL-ilBg0qmQxBe76OkA?e=AKcSOF

Kind Regards,
Jason

Posted Aug 21, 2024 - 10:06 BST

Update

Afternoon All,

Please be advised that we have now reconciled missing data from the 17th August 2024 and this is now available in the Measure Effect and Insights Platform.

The Data team will continue to work through the reconciliation with a view for this to be completed tomorrow
Wednesday 21st August 10:00AM GMT

If you have any questions, concerns or issues, reach to me directly and for more information, please refer to the following document:
https://advsmo-my.sharepoint.com/:b:/g/personal/aravind_flixmedia_tv/EVNTMV-WqQtPiqzzg5m-9EkB3ruzL-ilBg0qmQxBe76OkA?e=AKcSOF

Regards,
Jason

Posted Aug 20, 2024 - 15:59 BST

Update

Afternoon All,

Please be advised that we have now reconciled missing data in Insights from 14th and 15th August.
This data will now be available in the Measure Effect platform.

The team are continuing to work through the reconciliation with an aim to complete this by tomorrow.

For more information, please refer to the following document:
https://advsmo-my.sharepoint.com/:b:/g/personal/aravind_flixmedia_tv/EVNTMV-WqQtPiqzzg5m-9EkB3ruzL-ilBg0qmQxBe76OkA?e=AKcSOF

Kind Regards,
Jason

Posted Aug 19, 2024 - 17:09 BST

Identified

Morning All,

Please be advised that our data team have begun the reconciliation of the missing data in Measure Effect/Insights

Data Affected: Wednesday 14th to Friday 16th August

The team expect to complete this by 4pm today and provide an update.
If there are any delays in this, we will sure to inform you.

For more information, please refer to the following document:
https://advsmo-my.sharepoint.com/:b:/g/personal/aravind_flixmedia_tv/EVNTMV-WqQtPiqzzg5m-9EkB3ruzL-ilBg0qmQxBe76OkA?

Kind Regards,
Jason

Posted Aug 19, 2024 - 10:28 BST

Update

Afternoon All,

Please be advised that the Data Team are continuing to work directly with Limelight on this issue.
We have raised the following incident with the team: INC2259584

To manage expectations, please be advised that the team will work through the reconciliation this weekend with a view to provide the next update by Monday 10:00AM GMT.

If have any queries, please refer to the following document: https://advsmo-my.sharepoint.com/:b:/g/personal/aravind_flixmedia_tv/EVNTMV-WqQtPiqzzg5m-9EkB3ruzL-ilBg0qmQxBe76OkA?e=AKcSOF alternatively reach out to myself or Aravind directly.

Regards,
Jason

Posted Aug 16, 2024 - 16:12 BST

Update

We are continuing to investigate this issue.

Posted Aug 16, 2024 - 14:00 BST

Investigating

Afternoon All,

Please be advised of the following incident flagged by our data team this afternoon:

Incident Name: Delays in Data being received through to Measure Effect

Description: Today, we have received an alert indicating a discrepancy between Limelight and GCS files. In response, we promptly halted our main ETL process. Since then, we have been monitoring the situation, and the files continue to be received. Our next update to be given by today 16:00 BST. Once all the files are received we will start the manual build.

Data Affected: Wednesday 14th & Thursday 15th August 2024

Actions taken:
1. The routine pipelines have been paused
2. A support ticket has been raised with Limelight
3. The Limelight team are now investigating this.

We will be sure to let you know as soon as we have received anything further back from the Limelight team
If you have any questions in the meantime, please reach out to myself or Aravind in the Data Team directly.

For more information, please refer to the following document:
https://advsmo-my.sharepoint.com/:b:/g/personal/aravind_flixmedia_tv/EVNTMV-WqQtPiqzzg5m-9EkB3ruzL-ilBg0qmQxBe76OkA?e=AKcSOF

Kind Regards,
Jason

Posted Aug 16, 2024 - 14:00 BST

This incident affected: Measure Effect and Insights.