Instead of wasting cycles on the ‘integration tax’ of wiring together a collection of products, worrying about spinning up and managing infrastructure and stitching together disparate data sources, we want data engineers to focus on the jobs to be done. With Synapse Data Engineering, we aspire to streamline the process of working with your organizational data. What’s included in Synapse Data Engineering? With data engineering as a core experience in Fabric, data engineers will feel right at home, being able to leverage the power of Apache Spark to transform their data at scale and build out a robust lakehouse architecture. Microsoft Fabric empowers teams of data professionals to seamlessly collaborate, end-to-end on their analytics projects, ranging from data integration to data warehousing, data science and business intelligence. Today, we are excited to announce the preview of Synapse Data Engineering, one of the core experiences of Microsoft Fabric. This results in friction and project roadblocks, hampering productivity and leading to frustration. These processes are complex – data is fragmented across many sources, data sharing requires ETL jobs and synchronization, often to proprietary stores, security needs to be replicated multiple times, leading to inconsistencies. Data engineers need to tackle numerous challenges including data consolidation, security considerations as well as democratization of data, catering to different consumption needs. All this data needs to be ingested, processed at scale, and shared with the business. The amount of data that needs to be processed is growing faster than ever, ranging from tabular data to unstructured documents, images, IoT sensors and more. See Arun Ulagaratchagan’s blog post to read the full Microsoft Fabric preview announcement.ĭata engineering is playing an increasingly foundational role in every organization’s analytics journey.
0 Comments
Leave a Reply. |
AuthorWrite something about yourself. No need to be fancy, just an overview. ArchivesCategories |