BACKGreat things can be accomplished with the right Talend
Combining data sources seems as interesting as utilities bringing us electricity, gas and water right? We pay little or no attention to how these life giving sources are come to us, we combine them to sustain our basic needs.
Copper, a rare earth metal, became costly to use in the housing industry. It’s since been replaced with a plastic pipe alternative that provides the same utility at a fraction of the cost.
So what does this have to do with cloud-based integration?
Until recently, moving data from one system to another could only happen between could only be accomplished between data installed in your data centers.
Realizing the importance and focusing in on integration tools, product developers such as Informatica, IBM and Oracle set out on their quest for leadership in integration. These products all offer configurable products with connectors to common data sources – making it very flexible to bring together multiple data.
Cloud-based integration tools at their heart principally Extract, Transform, and Load (ETL) data. They act as conductors used to move data from external or internal source databases to your data stores or lakes.
- Extract reads the data from your source database, using rules criteria.
- Transform is the curation function, telling the data how it needs to conform to the rules of the target system.
- Load functions take the formatted data from above and write them to specific data tables in the target system.
How can cloud-based integration help your business?
Many of our business clients are gaining an edge by using integration tools for:
- Accumulating data sources for analytics, business intelligence (BI) and data warehousing applications by transforming and combining data into data models rapidly for analytics.
- Ensuring compliance with master data sources, commonly known as master data management (MDM) for customers, products or employees.
- Having data consistency between transactional programs such as CRM for sales order taking and ERP for fulfillment.
- Combining data from external partners who provide transactional or market related data which requires transfer and transformation to round out the picture of their business operations.
Our customers are demanding data availability for analytics purposes, helping make current decisions. As the thirst for greater velocity of data for decision making increases, our ETL solutions allow for real time data flowing to applications. We also know that there are more sources of data than ever before, especially coming from all of the applications consumers are taking advantage of. Allowing our customers to capture data from many sources as quickly as possible provides the best information to our customers.
ETL is cost-effective with the right Talend
Cost is a major consideration for many of our customers in the mid market space as well as IT staffs availability for providing integration services.
“As an Amazon Web Services (AWS) partner, CopperHill Consulting looks first and foremost to offer clients solutions using the best open source tools available,” says Paul Kukk, CTO. This is the philosophy that inspired Paul to create CopperHill AIR – our data integration, storage, and analytics solution – on AWS.
It allows us to provide affordable services on a reliable platform, using an on-demand integration tool from a company called Talend. Talend comes as an integrated service option when you purchase a subscription server on AWS, making ETL services affordable and a reality for any sized business.
CopperHill AIR uses Talend and its rich pool of data connectors to enhance products like Salesforce, Oracle, or SAP. Data connectors are the pipes that read the tables from your data sources. They make quick interpretations of that data. Because Talend’s connectors have the ability interpret what the tables in your source system look like, your time to be up and running can be counted in days.
What if you have unique or custom databases you want to integrate?
As long as a system has an Automated Programming Interface (API), we can apply Talend to read the tables in the source system and interpret the data you need to extract. As long as the data model is readily interpretable data can be extracted.
Want to find more information about cloud-based integration?
You can read more on our cloud-based integration page or feel free to contact us. We’ll be happy to answer any questions you have and help you solve your integration problems. If you are interested in learning more about Talend, visit their website: https://www.talend.com/.
