OneWeb

• 10 Trillion Rows of Data: 55 Billion Rows of data ingested daily and cataloged automatically

• Data Mesh Implementation in 1 Year: Established a fully operational data mesh in less than a year with just a 7 person team

• From Weeks to Seconds: Drastically shortened data sharing timelines, boosting decision-making efficiency

Trillions of Rows, Zero Sweat! 

Imagine launching a constellation of 600+ satellites into space- each designed to open up, start charging, and send vast streams of data back to Earth. Now, picture all this data—55 billion rows daily, growing continuously, across tables with more than 10 trillion rows and managed through 32 Snowflake tenants—being automatically cataloged and made readily available to end users with all the necessary data products. Envision prototyping this entire system in just 6 weeks and transitioning to full production in less than a year. This isn't just a thought exercise; it's exactly what OneWeb achieved with Snowflake and data.world. 

Business Challenge

OneWeb faced the formidable task of seamlessly collecting, transforming, and utilizing data derived from space. With a daily influx of 55 billion rows, and some tables swelling to over 10 trillion rows, managing this vast volume of data and maintaining its usability presented significant challenges. For OneWeb employees, the staggering scale of this data could be daunting. 

For a OneWeb employee, this staggering scale of data can be overwhelming. Where do you find the right data to answer your business questions? Who do you contact for questions about the data you discover? How can you be sure the data is reliable? This is where data.world steps in.

We have 32 Snowflake tenants across sales, marketing, etc., and not all users have access to all of these tenants, but they probably need to access this data, so we use data.world as our enterprise data catalog." - Miguel Morgado, Product Owner at OneWeb

Solution

Data.world stepped in to streamline OneWeb's data operations using its advanced data catalog and governance solutions. The integration focused on:

• Semantic Search: Utilizing a knowledge graph-based search, akin to Google's top concept knowledge card, to swiftly locate relevant data.

• Lineage Tracking: Offering a queryable lineage system enabling users to trace data origins and dependencies, thereby enhancing data trust and accuracy.

• Collaborative Features: Facilitating direct collaboration within the data platform through built-in discussion threads, @mentions for querying peers directly on data products, and simplified processes to request access or suggest data modifications.

Results

The implementation of data.world’s solutions significantly enhanced OneWeb’s data management capabilities, emphasizing quantifiable improvements:

• Seconds to Share: Data sharing timelines slashed from weeks to seconds, streamlining communication and decision-making.

• Dashboards in Hours: Reduced dashboard creation time from weeks to hours, now supporting over 700 active dashboards for immediate data visualization.

• 55 Billion Rows of Data Daily: Automated daily ingestion of 55 billion rows of data, transforming manual efforts into a sleek, productive process.

• Data Mesh Implementation in 1 Year: Established a fully operational data mesh in less than a year with just a seven-person team, showcasing remarkable scalability and efficiency.