Job Description
Senior Database Engineer (Elastic/Mongo/Hadoop)
Join to apply for the
Senior Database Engineer (Elastic/Mongo/Hadoop)
role at
CatchProbe Intelligence Technologies
Workplace Type:
Remote -
Region:
San Francisco, CA
Job Description
Must have experience with MongoDB installations, upgrades, and support.
Responsible for administration, maintenance, performance analysis, and capacity planning for MongoDB/Elastic/Hadoop clusters.
Coordinate and plan with application teams on MongoDB capacity planning for new applications.
Should have knowledge of using MongoDB tools like mongodump, mongoexport, mongorestore, mongoimport, mongostat, and mongotop.
Must be well-versed with JSON scripting and writing queries in MongoDB shell scripts.
Should be able to support sharded clusters and perform upgrades and configuration maintenance.
Must be able to monitor and manage capacity requirements: CPU, memory, and storage.
Assist application teams with assessment and/or resolution of performance bottlenecks in the MongoDB Database tier.
Must be aware of different authentication/authorization methods in MongoDB including SCRAM-SHA1, X509, and LDAP.
Ability to develop automated solutions for ad-hoc script execution requests, report generation, upgrades, and installations.
Experience in NoSQL DB technologies.
Knowledge of using Cloud Manager and sharing relevant metrics for deployments when issues arise.
Experience with Docker, deploying Mongo containers, and supporting MongoDB administration within Docker containers.
Knowledge of administration and support of Hadoop systems is a plus.
Deploy Hadoop (Big Data) clusters, manage nodes, track jobs, and monitor services like Zookeeper and HBase.
Develop scripts to review logs and alert for long-running queries.
Demonstrable expertise in data storage technologies: Postgres/MySQL, Kafka/Kinesis.
Strong scripting experience with Python (preferred) and Shell (secondary).
Individually build services and expose internal APIs for data infrastructure automation components.
Required Skills
Strong understanding of various relational and non-relational database technologies.
5+ years of experience installing, automating, scaling, and supporting NoSQL databases like MongoDB, ElasticSearch, and Hadoop.
1-2 years of experience working with databases in public Clouds like AWS, Azure, and GCP.
Proficiency in automation.
Knowledge of Ansible, Python, and Terraform.
Willingness to learn other database, automation, and Cloud technologies.
Great communication and collaboration skills.
Software development experience and knowledge of modern software development processes.
Knowledge/experience in programming languages such as Java, Go, Node.js, HTML, CSS, Bootstrap is a plus.
Knowledge/experience in AI/ML is a big plus.
Ability to multi-task and prioritize with little to no supervision.
Ability to work well under pressure.
Consistent exercise of independent judgment and discretion.
Excellent communication skills.
Highly driven and proactive.
Datalake cluster ownership and technical point of contact for all applications on the Hadoop cluster.
Responsible for new application onboarding in the Datalake.
Assist applications in finding optimized and suitable solutions.
L3 point of contact for issues related to Hadoop platform.
Core Responsibilities
Develop solutions for complex systems engineering problems and create documentation for others to maintain systems.
Provide in-depth knowledge of Operating Systems to solve complex problems and mentor junior team members.
Master understanding of database concepts, availability, performance, and configuration.
Set up and tune complex SAN software issues and recommend new technologies.
Develop software in modern languages and design horizontally-scalable solutions.
Recommend or help architect systems, including network design and topology.
Analyze systems and make recommendations to prevent possible problems.
Lead end-to-end audits of monitors and alarms based on subsystem knowledge.
Apply time management and project management skills to lead issue resolution.
Regular, consistent, and punctual attendance.
Seniority Level
Mid-Senior level
Employment Type
Full-time
Job Function
Information Technology
Industries
Software Development
#J-18808-Ljbffr Catchprobe
Job Tags
Full time, Remote job,