DiAGRAM: A Shiny app for the National Archives

DiAGRAM: A Shiny app for the National Archives

The National Archives


Public Sector

We were very impressed with what you achieved over the 6 weeks and also with how organised you were around documenting and managing your side of the project. Alex Green (National Archives)

The Challenge

The National Archives required development of a web based application that would allow their users to build and compare storage policies to help archivists manage risk to their digital collection. The project started in September 2020 and was live just 6 weeks later.

The aim was to provide an intuitive interface for users to provide information about their archive or potential policy changes in order to leverage a Bayesian network model to estimate risk scores of key factors in successful preservation of digital material.

The solution must provide the ability to quickly build these models and policies, whilst also allowing scope for advanced users to control the finer nuances of the underlying network. The information must be able to be downloaded and restored within the application as well as providing visualisation and report download options.

The Project

The National Archives already had the Bayesian network model available in a binary format for the R programming language.

In six weeks through a series of three sprints and rounds of user testing we built a dashboard style solution using Shiny, with custom input widgets built using React.

In addition to providing a flexible interface that allowed for non technical staff to take ownership of the content, question types and scoring mechanism of the application, there were requirements to adhere to web content accessibility guidelines (WCAG 2.1).

Our Results

Understanding risk to digital assets is a complex process so our dashboard solution provided intuitive navigation through the various elements that a user should understand by providing downloadable guides and links to relevant standards and frameworks. For the creation of their own risk models, users are guided through a series of questions which estimate probabilities of nodes in the underlying network.

Custom React Widgets.

Each model could be easily edited, or used to form the basis for estimated change in risk under possible policy change. The tool provides visualisations for quick comparison of policies and understanding the causal relationship between different elements of the underlying network used to estimate risk.

All information could be downloaded as reports either via a branded pdf or csv data. Advanced customisation allowed advanced users to directly manipulate the probabilities of nodes in the underlying network.

The application was provided bundled inside an R package which allowed dependencies and tests to be managed naturally for ease of deployment and provided documentation for the client to take on the maintenance role.

Stakeholders were very impressed by the amount of work achieved by our team in such a short turn around with the changing goals that came through the agile process and the communication and management of project evolution.

Relevant Case Studies

DiAGRAM: A Shiny app for the National Archives

The National Archives

Jumping Rivers created a feature rich, bespoke Shiny dashboard through a series of development and user testing sprints. Custom widgets were created using React, to give a tailored application. Using a combination of continuous integration and deployment, the dashboard was deployed directly to via GitHub.

Read more about The National Archives
Scottish Government: Fair Work Data Explorer - Shiny App

Fair Work Data Explorer

Jumping Rivers created a data pipeline and visualisation dashboard for public and policy maker consumption. The aim was to increase transparency and encourage positive change to the workplace environment. The application allows exploration of key performance indicators stratified by a host of protected characteristics.

Read more about Scottish Government
Banking Firm: Code Review & R Package Development

Banking Firm

The client came to Jumping Rivers having already written the code for their problem in VBA. They were trying to evaluate four measurements for agreements with their clients. However, VBA is limited in speed. Jumping Rivers were required to build a bespoke R package to replace and quicken the code.

Read more about Banking Firm
TRACS International: Dashboard Development for Monte Carlo Simulation

TRACS International

At the end of 2017, TRACS International contacted Jumping Rivers. TRACS International estimates the volumes of oil and gas in subsurface reservoirs. Their work involves combining a set of inputs for each reservoir layer (such as area, thickness, and up to five other inputs) – and then multiplying these inputs together.

Read more about TRACS International
Electrics Company: Applying Machine Learning Tools to Highlight Anomalous Data

Electrics Company

Over the last two years, we have been working with a cutting edge electronics company to build advanced algorithms using R and Python. Since they are at the research & design stage of the development process, their data structure is unique and challenging.

Read more about Electrics Company
Environment Agency: Development & Deployment of 'Water Body Explorer' Shiny App

The Environment Agency

After winning a Water Hub Hackathon, Jumping Rivers were contracted to create a platform for the client using R Shiny, published on Posit Connect. The platform aggregates raw data from many third party sources both internal and external to the EA, through bespoke APIs, commercial databases, and asset management systems.

Read more about Environment Agency
Financial Institution: Bespoke Report Generation using R Markdown

Financial Institution

The client wanted to assess the viability of R and R Markdown as a reporting tool for creating complex, bespoke documents. We recreated sample reports for them in R Markdown, showcasing that all of their specifications could be met, and provided them with example code and training.

Read more about A Financial Institution
Fujifilm: Shiny Dashboard Creation for Experimental Risk Assessments

Experimental Risk Assessments

Jumping Rivers built a tool for creation of experimental risk assessments via a centralised web application. The dashboard allows for collaborative working during the data entry and assessment formulation, report generation and tracks versions along iterations of the process.

Read more about Fujifilm
NHS Scotland: R Training

NHS Scotland

In the spring of 2018, NHS Scotland expressed a need to move from their existing software, SPSS and SAS, to using R. The difficulty they faced was that there are over two hundred data scientists in NHS Scotland, which made training everyone in the new software a logistical challenge.

Read more about NHS Scotland
Northumbrian Water: Interruption to Supply Risk Mapping using Spatial R Package

NWL Risk Mapping

In spring of 2020 Northumbrian Water engaged with Jumping Rivers to build a modelling solution to better understand risks to the consumer within their network in order to provide a better service.

Read more about Northumbrian Water