The BBC Archive contains material dating the back to the 1880s, preceding the formation of the Corporation itself.
Following on from the successful roll-out of the Archive Search project which delivered a search portal for journalists and researchers to find and use those “golden nuggets” of archive footage, I was re-engaged to consult on the delivery of a complementary, public-facing web app that the archive editorial team had conceived.
The aim of the "Discover" app is to allow members of the public to use the same rich search and discovery functions that the Archive Search app gives to internal users but over a much smaller whitelisted section of the archive. The editorial team required the ability to manage the content and a back-office approval workflow was needed to ensure that restricted footage wasn't incorrectly published.
On a technical level, since the Discover app was public-facing, security and scalability were even more important than with the original Archive Search project.
The app followed a largely similar architecture to the Archive Search portal, with ElasticSearch, MongoDB and a Node.js based web app.
The app was deployed on containers on AWS ECS. Archive content was stored in S3 and delivered via CloudFront.
Other significant technologies used include: ELB, Docker, Lambda, CloudFormation.
The proof of concept was a success. We have continued to build the product and have committed more internal effort to it on the way to its release.
Overall Paul is just a good person to have on the team, even if it is just for a short while. He’s honest and realistic about what can be achieved with his help, which was invaluable to both project management and system design in our tight project timescale. He worked with the other developers to solve issues and articulated potential long-term issues so that we could avoid them in the future. He ensured that we had sufficient handover documentation which was greatly appreciated.
Paul engaged fully with eliciting requirements and the project goals, so he understood our team’s intentions quickly and co-ordinated easily with our own developers. ”
- First usable version of the Discover app delivered within 1 month of start of engagement
- Proof-of-concept app very well received by editorial team and more funding acquired to proceed with roll-out
- Knowledge transfer to in-house engineering team on AWS best practices around networking, security and infrastructure-as-code