Garbage In -> Garbage Out Dirty Data In -> Dirty Data Out

No matter how you word it or the saying you use the outcome is the same. The output can only be as good as the input. We are surrounded by a plethora of data from various sources and some of that data can be linked together through a common field (primary key). Data becomes more powerful when we can connect it to other systems that we use to create what many call the “Complete Picture”.

A single source of truth is needed as a starting point. The source of truth is often a platform such as an HR Platform, CRM Platform, or a Student Information System (SIS). All of these platforms have one thing in common which is a database structure which relies on primary keys to link data within the system.

A primary key in this situation could be a student id, employee id, etc. which cannot be changed and is specific to the system of truth. We can then utilize that ID in other platforms where it may be called an external ID, Local ID, or other names. When we can bring this ID into other platforms we setup a connection between the two platforms that allows us to ensure we are working with the same “record” between two platforms. When we have this connection we open ourselves up to a world of data gathering between multiple platforms.

More often than not an integration specialist is coming into a situation where platforms are already in place, they may not all be connected, and the idea of establishing a key between the two is not so simple. This is where the expertise of someone versed in databases and integrations is needed to generate the desired outcome by getting creative.

(Insert Drawing of Structure)

I was tasked with getting three of our platforms to “talk” with one another. The challenge was there were two sources of truth. How? The answer is that Salesforce contained records about the “organization” we worked with while our app platform dealt with the users who utilized our product. There were some overlap between these two platforms but not enough to classify one over the other as the single source of truth.