B3, one of the world’s leading financial infrastructure companies that acts as Brazil’s stock exchange, was facing significant challenges related to its IT infrastructure, especially in its Hadoop data environment. With its entire Hadoop structure implemented on-premises, the company had high costs for maintenance, data protection, updates and system evolution, including the cost of licensing SQL Server. Indeed, licensing represented a significant portion of B3’s IT investment. In addition, the scalability of the infrastructure was reaching its limit, with data storage needs nearing 100 terabytes and processing requirements soon to require a doubling in capacity.
B3 was faced with two options: invest in duplicating its on-premises infrastructure, which would entail high costs and additional responsibilities, or migrate to a cloud computing environment, which offers infinite availability and scalability. The company decided to look for alternatives that would eliminate the dependence on licensing, provide increased scalability and a balance between cost and performance.
The ideal solution found was to migrate on-premises data to a structured data platform in the Amazon Web Services (AWS) cloud. This decision would allow B3 to benefit from the advantages of the cloud such as availability, scalability and the use of open-source technologies. By adopting managed services, the company would transfer the responsibility for maintenance, security and system updates to the cloud provider, in this case, AWS.
Why B3 chose Ingram Micro
To ensure a successful migration and take full advantage of the benefits of the cloud, B3 chose Ingram Micro, a leader in the cloud services market, as a partner to assist in the process. Ingram Micro has the experience and expertise to ensure a smooth transition, ensuring that B3 benefits from the advantages of the AWS cloud.
The Hadoop databases were divided into three large groups: platform and transactional systems; partner data; and provider-originated data. Among the challenges for the migration were the significant data volumes, the orchestration of the various architectures, the refinement of the data, the validation and verification of the migrated data, and the implementation time.
A cloud-based solution
Ingram Micro began a comprehensive assessment of B3’s data, seeking to identify opportunities for improvement and define a strategy to enhance information management. As part of this work, Ingram Micro prepared for the migration to the AWS cloud infrastructure, adopting best security and compliance practices to ensure data integrity.
During the migration, Ingram Micro ingested the data, adopting end-to-end encryption measures to protect sensitive information in transit. In addition, the team used the Amazon Elastic MapReduce (EMR) service to transform and process all the information in an efficient and scalable manner.
For data consumption, solutions such as Amazon Redshift and Dremio were implemented, allowing fast and efficient access to information stored in the AWS cloud. At the same time, Ingram Micro worked closely with B3 to ensure compliance with LGPD, the Brazilian General Data Protection Law, implementing the necessary measures to ensure adequate data governance.
Additionally, Ingram Micro created a sandbox environment that provided data science teams with a safe space to explore and utilize the full suite of artificial intelligence and machine learning (AI/ML) services offered by AWS. This allowed testing and experiments to be conducted without compromising data integrity or system security.
At the end of the process, Ingram Micro successfully completed the full migration of the Hadoop platform to AWS, resulting in an optimization of all functional procedures.
Counting up the benefits
B3 now benefits from a modern cloud infrastructure, with greater security, scalability and efficiency in data management. Specific benefits include:
- Fixed costs: financial predictability, without unforeseen expenses.
- Information security: guaranteed backups, data recovery and encryption.
- Software updates: cloud computing provider’s responsibility.
- Specialized technical support: professional assistance in case of need.
- Intuitive platforms: ease of use and simplified management.
- Rapid implementation: immediate activation of the system in the cloud.
- Scalability: ability to expand the service according to demand and use AWS as an extension of the B3 data center.
- Future-proofing: Implementing modern data architecture for greater efficiency.
- Big Data: storage, visualization and advanced data processing.
Learn how Ingram Micro and AWS can help modernize your IT environment.