Big Data Engineer
Big Data Engineer
Boston, MA (possible remote, some travel required)
BigR.io is a technology consulting firm empowering data to drive innovation and advanced analytics. We specialize in cutting-edge Big Data, Machine Learning, and Custom Software strategy, analysis, architecture, and implementation solutions. We are an elite group with MIT roots, shining when tasked with complex missions. Whether it’s assembling mounds of data from a variety of sources, surfacing intelligence with Deep Learning, or building high-volume, highly-available systems, we consistently deliver.
With extensive domain knowledge, BigR.io’s architects, engineers, and scientists design and build best-in-class solutions across a variety of verticals. This diverse industry exposure and our constant run-in with cutting-edge technology equips us with invaluable tools, strategies, and techniques. Our knowledge and horsepower bring innovative, cost-conscious, and extensible results to complex business challenges. We are creating a community of thought leadership and a culture that strives to learn, embrace, and invent new approaches to complex problems. Collaboration amongst like-minded individuals is contagious and we thrive on pushing the edge of the pattern.
About the Job:
Our thought-forward Big Data team is working on a number of data architecture and software solutions projects. You will join this high-caliber team as a Big Data Engineer who will have a role in driving our client’s data management, performance, governance, and security goals with appropriate architectures and technologies.
For you to be successful in this role, you will have exceptional technical leadership abilities, a very strong background in working with “Big Data”, strong software and database design experience, broad knowledge across different technologies and frameworks, and an exceptional ability to communicate effectively.
- Assisted in designing and implementing datastores and ingest pipelines to manage massive amounts of data.
- Designed and built APIs with clean interfaces.
- Collaborated with architects to capture, format, and prepare data.
- Experience with Spark for data ingestion and formatting use cases, especially using Databricks.
- Strong Scala skills. Java/Python experience is a plus.
- Comfortable with Big Data ecosystem technologies: Hadoop, MapReduce, Hive, Pig, MongoDB, Cassandra, Kafka, etc.
- SQL chops a big bonus.
- AWS, Azure Cloud knowledge (S3, Azure Resource Manager). Knowledge of Azure HDInsight would be groovy.
BigR.io is a technology consulting firm empowering data to drive analytics for revenue growth and operational efficiencies. Our teams deliver software solutions, data science strategies, enterprise infrastructure, and management consulting to the world’s largest companies. We are an elite group with MIT roots, shining when tasked with complex missions: assembling mounds of data from a variety of sources, building high-volume, highly-available systems, and orchestrating analytics to transform technology into perceivable business value.
With extensive domain knowledge, BigR.io has teams of architects and engineers that deliver best-in-class solutions across a variety of verticals. This diverse industry exposure and our constant run-in with the cutting edge, empowers us with invaluable tools, tricks, and techniques. We bring knowledge and horsepower that consistently delivers innovative, cost-conscious, and extensible results to complex software and data challenges.