Ayan Infotech has an urgent and immediate opportunity for a Big Data Engineer/ Analyst for a long term contract job opportuniy in Sydney or Melbourne.
All applicants must have full unrestricted work rights in Australia.
Title: Big Data Analyst
Location: Sydney or Melbourne
Type: Contract (Asap to 6 months, will extend)
Experience: 5 years or more
Required Skills and Experience:
As a Big Data Analyst, you will be responsible for designing, developing, and maintaining robust data pipelines. You will work closely with cross-functional teams to understand business requirements, optimize data workflows, and ensure the reliability and performance of our data systems.
Key Responsibilities:
- Creating an information architecture for a data set and ensuring it is easily accessible and understandable to everyone
- Proactively analyze data to answer key questions for stakeholders or yourself, with an eye on what drives business performance, and investigate and communicate which areas need improvement in efficiency and productivity
- Create and maintain rich interactive visualizations through data interpretation and analysis, with reporting components from multiple data sources
- Streamlining data collection methods to create automated and easy-to-use routines
- Design data processing pipelines using Apache Spark, Python, Scala.
- Implement performance tuning techniques to optimize data processing and query performance, ensuring scalability and efficiency.
- Implement and adhere to best practices for data governance, security, and compliance.
Requirements:
- Familiarity with common software tools used for big data analysis. These include SQL databases, Python and others
- Strong understanding of statistical analysis techniques
- Technical experience working with data models, database design development, segmentation and data mining techniques
- The ability to communicate complex information effectively in report form
- Experience with performance tuning and optimization of SQL queries.
- Fluent with the workings of platforms for data processing, such as Apache Spark
- Data visualization software knowledge like PowerBI
www.ayaninfotech.com
