Leading Online Marketing & Software Company

Summary

The Director of IT Architecture at the company required a streaming data analytics solution on AWS which incorporated multiple data sources. To do so the company required the expertise of a cloud and big data partner experienced with AWS big data architecture and best practices. As an AWS Big Data Competency holder, Relus Cloud was selected to design and configure a streaming big data analytics solution on AWS.

Opportunity

As the leading online marketing and software company the company saw a unique opportunity to integrate multiple data sources. AWS offered agility and depth of services unmatched by other cloud-based providers. With a streaming data analytics solution, the company was able to load multiple data sources into Kinesis from S3 and RDS and validate, transform, and post metrics to RedShift and RDS.

Solution

Relus Cloud performed a full platform assessment to inform the reference architecture design based on best practices that are built to scale and grow as AWS adoption increases. The consulting deliverables included AWS environment diagrams and design, documented process for inputs, Spark process diagram, documentation for outputs, RedShift schema and process documentation, and Data Pipeline documentation. These deliverables included diagrams & documentation, a kickoff meeting, all scripts/source code, and a training workshop. Relus Cloud leveraged several AWS services, including Redshift, EMR, RDS, Elasticsearch, CloudWatch, SNS, CloudFormation, CloudTrail, VPC, and S3.

The newly built architecture allowed the company to incorporate new data sources, provided the company an introduction to the power and value of EMR and Redshift, and delivered the company a production ready streaming analytics solutions that can be extended to additional data sources.