The Data Engineer develops, defines, maintains and implements all the tools and infrastructures required to analyze the data collected by the Data Science teams. He has a strong mastery of Big Data technologies, which enables him to process and manipulate data (Spark, Hadoop, Kafka...) in the best possible way. He has a strong expertise in database design (SQL, NoSQL) and is a true specialist in structured languages. The production set up, which the Data Engineer will provide to his colleagues, must be readable and easy to handle. The clarity of the structures produced is therefore essential for the proper development of the data processing process.
The Data Engineer works in close collaboration with the Data Scientist. He designs platforms that will enable the processing of a very large volume of data.
His work also consists of leading a team. He will ensure that the data pipelines are clear and optimally secured so that they can be analyzed and then transformed by the Data Scientist.
Although the Data Scientist is the best known profession in the field of data processing, the Data Engineer is the leading specialist in data processing.
In terms of training, the Data Engineer studies at a higher engineering school, a master's degree specializing in Data Science or Artificial Intelligence, or a school of computer science. It is often recommended that Data Engineers complete an internship or work-study contract in order to acquire all the skills necessary for this job. Indeed, he must have very specific skills such as mastering structured language (Javascript...) and various operating systems (Linux, Solaris...), Big Data technologies, "machine learning" on Google Cloud, but also speak English fluently.
So, if you wish to collaborate with the Data Engineer best suited to your business intelligence, whether you are located in a Swiss city (such as Geneva or Lausanne), entrust UNE with the privilege of setting up a selection of the best profiles that will match your request.