Spark Streaming Architect
Location: Remote Work

Job Description:

Technical Architect – Spark Streaming Architect (Postgres SQL, Kafka)

Location : Remote 
 

 

  • 10 +years Design and implement efficient data handling system based off Postgres or Spark tech stack.
  • Experience investigating/troubleshooting & resolving PostgreSQL performance issues, SQL query tuning and optimization.
  • Experience in Database Administration, specifically in PostgreSQL. 
  • Perform and oversee tasks such as writing scripts, calling APIs, and writing SQL queries.
  • Implement data stores that support the scalable processing and storage of our high-frequency data.
  • Hands-on experience with data cleaning, visualization, and reporting
  • At least 4 years of relevant experience with real-time data stream platforms such as Kafka and Spark Streaming
  • Experience working in an agile environment.
  • Familiarity with the Hadoop ecosystem
  • Experience with platforms such as MapReduce, Spark, Hive
  • Experience with AWS is required. 
  • Excellent analytical and problem-solving skills

Excellent communication and interpersonal skills

 

 


Key Skills:

  • "Spark Streaming" and "Kafka" and "Scala" and "PostgreSQL" and "Hadoop"