Publicat 08 Feb 2021 | Reactualizat 22 Feb 2021 | Expiră 10 Mar 2021

Data Engineer

1 post

Criterii de selecție

  • Peste 3 ani experiență în muncă

Candidatul ideal

Contribute to the business value of Data-oriented products based on on-premise Data lake or on cloud environments, by implementing end-to-end data processing chains, from ingestion to API exposure and data visualization
General responsibility: Quality of data transformed in the Data lake, proper functioning of data processing chains and optimization of the use of resources of on-premise or cloud clusters by data processing chains
General skills: Experience in the implementation of end-to-end data processing chains and Big data architectures, mastery of languages ​​and frameworks for the processing of massive data in particular in Streaming Mode (Spark / Scala). Practice agile methods.

Descrierea jobului

Main responsibilities

During the iterative realization phase
Implementation of data ingestion chains
Implementation of data preparation chains
Implementation of basic ML algorithms
Implementation of data visualizations
Use of ML framework
Implementation of data products
Exhibition of data products
Configuration of NOSQL databases
Distributed processing implementation
Use of functional languages
Debugging distributed processing and algorithms
Identification and cataloging of reusable items
Contribution to the evolution of work standards
Contribution and advice on data processing problems

During integration and deployment
Participation in problem solving

During serial life
Participation in the monitoring of Operations
Participation in problem solving
Contribution and advice on data processing problems

Required Skills
Expertise in the implementation of end-to-end data processing chains
Mastery of distributed development
Basic knowledge and interest in the development of ML algorithms
Knowledge of ingestion frameworks
Knowledge of Spark and its different modules
Mastery of Scala
Knowledge of the use of Solace
Knowledge of the ecosystem of NOSQL databases
Knowledge in building data product APIs
Knowledge of Data visualization tools and libraries
Ease in debugging Spark and distributed systems
Popularization of complex systems
Control of the use of data notebooks
Expertise in data testing strategies
Strong problem-solving skills, intelligence, initiative and ability to resist pressure
Excellent interpersonal skills and great communication skills (ability to go into detail)
For the future architecture from next year:

Nice to have knowledge of the GCP ecosystem DataProc, DataFlow, BigQuery, Pub-Sub, PostgreSQL/Composer, Cloud Functions, StackDriver)
Nice to have knowledge of Beam and its different execution modes on DataFlow
Nice to have knowledge of Java

Descrierea companiei

Crystal System Group is today the IT strategic partner to some of the most influential corporations in Europe.
With headquarters in Cyprus, Crystal System has software factories located in Romania, Moldova, Greece and Albania, countrieswhere IT culture is widespread and it is possible to provide cost-effective services to global clients applying the Nearshore Delivery Model.
Leveraging the existing quality of the Academic world, over the years we have developed an original education and hiring approach based on partnerships with leading universities.
The considerable talent of our IT specialists provides our company with the unique capability of accelerating results and cutting costs while guaranteeing state‐of‐the-art quality, as required by market leaders. By focusing on quality through people, Crystal System Group has gained a competitive edge through extensive international experience in offering value added IT outsourcing consulting and development services.
Crystal System is a community of young and passionate technology enthusiasts.
If you are willing to learn, if you are ambitious, if you like challenges, we offer you a career with an international vision, diverse experiences and continuous growth.
Join us!

Data Engineer  -  Crystal System

E timpul pentru un browser mai bun

De la 1 octombrie 2019, te informăm că site-ul nu va mai putea fi accesat prin browser-ul Internet Explorer din cauza funcționalităților reduse ale acestuia. Accesează-ne cu încredere folosind unul dintre browserele mai moderne: Google Chrome, Mozilla Firefox, Safari sau Edge.

Am înțeles