This was happening between DBA's and BI technical guys long before it was happening between Data Engineers and Software Engineers. It's not just "The Data Contract", it's the "creativity" of working with data. Knowing that you are massaging data into a structure where business can ask questions from the data and ultimately make decisions from it. Software Engineers just don't get this, using terms like 'clever' when you succeed in designing a data product that uses 3NF and Normalisation techniques to map a complex concept into a working product. Make no mistake, Software Engineers play a very important role, especially in being the producers of data, but often lack the understanding and finesse of being data consumers. Equally, Data people often lack the knowledge of well structured data producing systems and often well structured security methods......and it appears this gap will continue for a while yet.
Thanks for sharing your thoughts Leon. It's absolutely not just the data contract – I didn't even know about the construct back when I was working with our engineers on data workflows.
I wonder what will help beat this gap between Engineering and Data for good. 🤔
This was happening between DBA's and BI technical guys long before it was happening between Data Engineers and Software Engineers. It's not just "The Data Contract", it's the "creativity" of working with data. Knowing that you are massaging data into a structure where business can ask questions from the data and ultimately make decisions from it. Software Engineers just don't get this, using terms like 'clever' when you succeed in designing a data product that uses 3NF and Normalisation techniques to map a complex concept into a working product. Make no mistake, Software Engineers play a very important role, especially in being the producers of data, but often lack the understanding and finesse of being data consumers. Equally, Data people often lack the knowledge of well structured data producing systems and often well structured security methods......and it appears this gap will continue for a while yet.
Thanks for sharing your thoughts Leon. It's absolutely not just the data contract – I didn't even know about the construct back when I was working with our engineers on data workflows.
I wonder what will help beat this gap between Engineering and Data for good. 🤔