PySpark Developer

PySpark Developer

Extelligence is an intelligent partner that goes the extra mile. We provide customized information management solutions for major industries. Our team in Prague and Bucharest is working with international companies, transforming, and adding value to their business on a daily basis. We are growing quickly, and we are interested to bring more talented individuals into our team.

Technical Experience

  • Fundamentals of Spark using the Dataframe API
  • Understanding partitioning of data
  • Analysing and performance tuning Spark queries e.g. looking at the DAG
  • Knowledge of Hadoop and its ecosystem of technologies especially Hive
  • Python
  • OOP concepts using Python
  • Knowledge of Conditional Statements & Loops: If-else Control Structures, For/While Loops
  • Demonstrate a comprehensive understanding of Complex Data Types: Shallow & Deep Copies, Working with Lists & Tuples, Dictionaries & Sets
  • Understand Fundamental Data Structures & their Implementation
  • Good knowledge of Exceptions & Command Line Arguments
  • Contributes to quality assurance by writing unit and functional tests.
  • Ensures development happens for all Software Components in accordance with Detailed Software Requirements specification, the functional design and the technical design document.
  • Basic knowledge of UNIX
  • Demonstrate source control knowledge (preferably GIT)
  • Ability to analyse databases directly using query language tools such as SQL
  • Experience on ETL process on Big Data
  • Have an understanding of data relationships, normalization

Non-Technical Experience and Skills

  • Use of JIRA / Confluence
  • Appreciation of release management and software maintenance
  • Provides Level 3 support
  • Contributes to problem and root cause analysis.
  • Collaborates with colleagues participating in other stages of the Software Development Lifecycle (SDLC).
  • Strong analytical skills.
  • Should have good understanding of architecture
  • Ability to work in virtual teams
  • Excellent team player and open minded approach
  • Ability to share information, transfer knowledge and expertise to team members.
  • Ability to design and write code in accordance with provided business requirements
  • Ability to work in a fast paced environment with competing and alternating priorities with constant focus on delivery.
  • Candidate is expected to have high desire to learn new technologies and implement various solutions in fast paced environment.

Nice To Have

  • Knowledge of control M
  • Hands on experience of Team City
  • Understanding of Financial Products
  • Ability to interpret and write complex SQLs

Project duration: 6-12 months

Working with Extelligence:

  • We take care of the important things that matter to contractors, for example, we guarantee on-time payment for your work. You will never have to chase us for payment.
  • We always seek to have long term relationships with our team and we always seek to offer opportunities to extend cooperation beyond the first contract or project.
  • Extelligence is a multicultural team, we have more than 10 different nationalities working with us.
  • We also organize events to bring our team together including team building activities and social events.

Job Type: Contract
Job Location: London

Apply for this position

Allowed Type(s): .pdf, .docx