1

Scaling a Meteorology Platform Analyzing Hundreds of Sources

Agriculture
AWS
Java

Description

A global provider of a weather forecasting system turned to Altoros to rebuild a cloud-native platform for analyzing meteorological data and driving meaningful insights.

Brief results of the collaboration:

  • The customer created a weather forecasting platform capable of analyzing meteorological data and delivering predictions with 97% precision.
  • A microservices architecture and the AWS-based technology stack ensured ease of maintenance and scalability.
  • Thanks to the delivered ETL pipeline, the system can transform unstructured meteorological data—gathered from 100+ weather stations, satellites, radiosondes, lightning detectors, etc.—for further analysis and visualization on synoptic charts.

The customer

Based in Greece, the customer is a provider of weather modification solutions, mainly to the agricultural industry. Founded in 1976, the company is among top 4 firms in its domain. The organization is well known for its hail suppression and precipitation increase (rain/snowfall) projects.

The need

The customer had a web-based app that analyzed meteorological data gathered from 6 types of sources. The latter included hundreds of the company-owned weather stations, radars, radiosondes, and lightning detectors, as well as satellites and other equipment deployed worldwide by international agencies. However, the technology stack behind the app was outdated, impairing performance and maintainability.

Representing mostly meteorology professionals, the firm relied on cloud-native development expertise at Altoros to develop a new robust system with a focus on high-precision data analysis and visualization.

The challenges

Under the project, the team at Altoros had to address the following issues:

  • Since the customer planned to expand to the European market and add more sources of meteorological data, it was important to ensure scalability.
  • The meteorological data from multiple sources was unstructured, requiring a common format for further analysis and visualization on synoptic charts.
  • To visualize up-to-date information, it was crucial to extract the meteorological data from the customer's aggregation server on a regular basis.

The solution

Stage 1. After analyzing the customer requirements, cloud-native engineers at Altoros conducted research around the optimal technology stack and architectural design. The team opted for Amazon Web Services, as it has all the necessary tooling to ensure scalability. In addition, Amazon Elastic Beanstalk helped to automate platform deployment.

A microservices-based architecture contributed to the system’s maintainability, allowing to build new modules without refactoring the whole system.

Stage 2. The data engineers built an ETL pipeline for working with unstructured information, such as meteorological maps (thermodynamic, pressure, streamline/winds, precipitation, etc.). For unification, the data was transformed to the JSON format and then loaded to the analytical module.

Stage 3. After that, the developers at Altoros delivered a scheduler to enable data updates between the customer’s aggregation server and the new system at preconfigured intervals.

Stage 4. In addition, the team created an algorithm that estimated temperature at a specified location—based on the data collected from the diverse sources—with a 97% precision.

Stage 5. The developers at Altoros made it possible to visualize data in a range of synoptic charts that illustrated different weather conditions (rainfall, wind, etc.).

Stage 6. Finally, QA engineers conducted unit, functional, performance, and acceptance tests.

100+

weather stations

4

types of charts

97%

prediction accuracy

The outcome

Partnering with Altoros, the customer developed a weather forecasting solution that aggregates, analyzes, and visualizes meteorological data on a range of synoptic charts. Gathering data from 6 source types (the WRF Model system, 100+ weather stations, radiosondes, satellites, and lightning detectors), the platform now features 97% prediction accuracy. Thanks to a microservices-based architecture and Amazon technology stack, the system is easy to maintain and scales to aggregate meteorological data gathered across the whole Europe.

Technology stack

Platform

Amazon Web Services

Programming language

Java

Frameworks and tools

Amazon EC2, Amazon Elastic Beanstalk, Spring MVC, Spring Data JPA, Spring Data JDBC, Hibernate, JUnit

Data stores

Amazon S3, Amazon RDS

You May Also Like

Automation of In-field Job Planning and Performance Optimization
Java
JavaScript
PostgreSQL
Information technology
Marketing
Call Recording, Analytics, and Workforce Optimization Solution
.NET
jQuery
C#
JavaScript
MS SQL
Information technology
Highly Scalable System for DNA Analysis
Hadoop
Java
Information technology
Healthcare
Sport
A Highly Secure Smart Home System Wins a Kickstarter Funding
Ruby
Ruby on Rails
JavaScript
Angular
PostgreSQL
MySQL
Information technology
The Image Recognition System
Java
MongoDB
NoSQL
e-Commerce
Integrated logistics solutions to the offshore industry
Android
LikeFolio: Best Practices of Cloud and Ruby Development for Application Optimization
NoSQL
MySQL
Ruby
Ruby on Rails
Marketing
Social media
Telecommunications
Finance
Data-Driven Analytics
Software for Selecting and Mixing Paint
.NET
MS SQL
C#
WP
Information technology
Retail
Software Suite for Mobile Technicians and Field Service Management
.NET
MS SQL
iOS
Android
Logistics and transportation
The System for Emergency Control Centers
.NET
C#
MS SQL
Healthcare
Sport
Logistics and transportation
The Cloud-based Document Exchange System
Java
jQuery
NoSQL
Information technology
e-Commerce
The Marketing Information Messaging System
.NET
C#
MS SQL
iOS
Marketing, Social media
Telecommunications
The NuoDB Migrator for Moving SQL Data to a NoSQL Database
Java
NuoDB
MySQL
PostgreSQL
Information technology
Manufacturing
Toyota Automates Its System for Holding Tenders
.NET
C#
Manufacturing
Warehouse Workload Monitoring Application
.NET
C#
MS SQL
WP
Logistics and transportation
Web-Based Personal Styling
Ruby
Ruby on Rails
JavaScript
jQuery
MySQL
Social media
e-Commerce
Web-Based System for Retailers
Ruby
Ruby on Rails
MySQL
MongoDB
Retail
e-Commerce
A Blockchain-Based Platform for Automating Bond Issuing Worth $10M
Bash
JavaScript
Blockchain
Finance

Contact us and get a quote within 24 hours

Damian Castelli
Business Development Manager
damian.castelli@altoroslabs.com
Headquarters
1-650-662-5052
Toll-Free
1-855-ALTOROS