This article provides a comprehensive list of datasets available in Arbor's BI Connector for LAs. It also outlines the refresh schedule for these datasets and highlights the increased refresh rate during exam results days.
Below you'll find a list of all the available datasets which is sometimes referred to as a Data Dictionary.
A full explanation of how to use the connector is available here: Arbor’s BI Connector
BI Connector Data Sets
DfE Datasets
Datasets which support statutory reporting requirements are managed by requesting DfE Data. The following datasets are available in ARBOR_MIS_ENGLAND_LA_MODELLED schema and cover:
Click this link to view the full Entity Relationship Diagram (ERD) illustrating how our datasets are connected together: LA ERD (Version 1.0)
MIS Datasets
Schools that choose to share DfE Data and MIS Data allow access to a much wider set of information. These datasets are in ARBOR_MIS_ENGLAND_MODELLED schema and cover:
Click this link to view the full Entity Relationship Diagram (ERD) illustrating how our datasets are connected together: ERD (Version 2.4)
Column-Level Data
See a full catalogue of column-level data here: Arbor LA BI Connector Data Catalogue
Refresh Schedule
The refresh frequency depends on the dataset. Please see the Data Catalogue for a full list of the views and their update schedules.
| Frequency | Description |
| Fast | Update every 30 mins |
| Medium | Updates at 7am, 1.20pm and 3.20 pm daily |
| Default | Update at 1am daily |
Results Day
On 14th, 15th, 21st and 22nd August 2024 we will increase the refresh rate for the following BI Connector Datasets. This is to help schools and trusts rapidly analyse their exam results.
From 5am to midnight we will refresh these datasets hourly and it will take approximately an hour to run. The datasets will refresh incrementally so some schools will have updated results immediately and other schools will wait longer for the update. Within an hour we expect all schools’ results to have been updated. Therefore at 7am you can expect the data to be live as of 6am.
We recommend that you check on the hour (as we kick off the refresh hourly and it takes approximately an hour to run). We cannot guarantee that the data will be updated precisely at these times.
| Schema | Dataset |
| Arbor BI Connector Production | SUMMATIVE_ASSESSMENT_MARKS EXAM_RESULTS EXAM_RESULTS_KS4_SCHOOL_HEADLINE EXAM_RESULTS_KS4_STUDENT_SUMMARY |
Please note that exam results come into the BI Connector as soon they are in the MIS and before the embargo period. Therefore please consider this when analysing exam results during the embargo period.
Notes on specific views
- Detentions - This view contains a row for each student who attends a detention. Therefore detention sessions will not appear unless a student attends that detention session.
- Academic Calendar Dates - Dates range from 1990-2029
- Internal Exclusions - This includes attendance.
- Intervention Staff Costs - Only schools who use this will have this data.
- Assessment Completion - Assessment Completion allows staff to view the completion rate (students with a mark or non submission reason are counted as complete) of an assessment by the group an assessment is assigned to, which includes courses, registration forms, year groups, academic years, teaching groups and custom groups. Only students enrolled in the group on the last day of the period are included.
- Custom Groups - Please note that there are student, staff and guardian custom groups.
Comments
Please sign in to leave a comment.