Big Data Analyst

A Data Scientist is an expert who uses Mathematical and Statistical methods to model how large pool of data could be analysed to derive useful information and insights so that effective decisions could be taken in business and in day to day life. For example, business can analyse consumer buying habits and purchase data to decide what should be the features of a new product which would have a high chance of acceptance by a group of customers. Google map analyses a humongous amount of real time GPS data to tell you out of the many alternative routes which would be the fastest route to reach your destination and would tell you the ETA (Expected Time of Arrival).

Data Scientists design and develop the models of data analysis (or the Mathematical or Statistical processes) as well as write the algorithms which are used by computer systems and software to organise and analyse the data as well as let us visualise the results or conclusions in a way so that it's easy for even common people to make sense of the data.

Data Scientist can use large pool of structured (such as spreadsheets like MS-Excel) and unstructured data (such as text, videos, images) to extract information and knowledge. Data scientists use powerful computer hardware, programming systems and algorithms to solve complex problems.

Data Analysts typically use computer systems and various data analysis software such as SAS, SAP Hana, IBM Cognos and IBM SPSS to check, compile, clean, transform and analyse data with the goal of discovering useful information, suggesting conclusions and supporting decision-making. Data is required to be regulated, normalized, and calibrated so that it can be extracted, used alone, or put in with other numbers to derive results. Data Analysts use various data visualisation tools to help common people and industry executives make sense of the data and learn from it.

Data Scientists are somewhat different from Data Analysts as Data Analysts generally don't develop the models for analysis or write complex algorithms for data analysis and visualisation. Data Analysts merely use various data analysis software to do their jobs.

An example could be - from a data of 10,000 FB walls, you are required to analyse the users' enthusiasm about a particular event and see which facebook pages or advertisement banners have been successful to generate the maximum number of positive comments and clicks. This is a job for a Data Analyst.

Now think of another example, where Facebook has asked its Data Scientists to extract key insights about all the users in India, say about their social engagement patterns as to how people are using Facebook, for what purpose, for how many hours in a day, in which device, and so on. Now these are complex questions which will require data modelling. This is a job for Data Scientists.

Key roles and responsibilities

As a Data Scientist, you will have different roles and responsibilities based on area or field. Following is the list of few roles and responsibilities across the specialities:

• You will work with the Data Science team and understand the business and its technical needs and design solutions based on them.
• You will partner with sales, Business development and services teams.
• You will work towards the development of machine learning, algorithms, operational research, semantic analysis, and statistical methods for finding structure in large data sets.
• You will use advanced statistics and machine learning on a large scale on large data with many data variables. You will produce actionable insights that can be used to drive operations and develop strategies for the company.
• You will breakdown business problems by working with Product Team, Marketing Team, Management etc. You will analyse the requirement of business problems and look into the data to find solutions.
• You will optimize operations of the organization by using data science in complex problem-solving.
• You will identify algorithms and machine learning techniques that should be applied to derive a solution for identified business problems.
• You will work closely with Business Development, Logistics, Marketing, Sales, Security and Customer Service teams.

Investigative: You should have interests for Investigative Occupations. Investigative occupations involve working with ideas and quite a lot of thinking, often abstract or conceptual thinking. These involve learning about facts and figures; involve use of data analysis, assessment of situations, decision making and problem-solving.

Conventional: You should have interests for Conventional Occupations. Conventional occupations involve repetitive and routine tasks as well as fixed processes or procedures for getting things done. These occupations involve working more with data, systems, and procedures and less with ideas or creativity.

Artistic: You should have interests for Artistic Occupations. Artistic occupations mostly involve working with creative ideas, art and designs. These occupations involve abstract or conceptual thinking, creative self-expression and often do not follow any set processes or rules for getting things done.

Abilities

Abstract Reasoning: The ability to understand ideas which are not expressed in words or numbers; the ability to understand concepts which are not clearly expressed verbally or otherwise.

Category Flexibility:  The ability to generate or use different sets of rules for combining or grouping things in different ways.

Deductive Reasoning: The ability to apply general rules and common logic to specific problems to produce answers that are logical and make sense. For example, understanding the reasons behind an event or a situation using general rules and common logic.

Flexibility of Closure: The ability to identify or detect a pattern (a figure, object, word, or sound) that is hidden among other distracting materials.

Inductive Reasoning: The ability to combine pieces of information from various sources, concepts, and theories to form general rules or conclusions. For example, analysing various events or situations to come out with a set of rules or conclusions.

Information Ordering: The ability to arrange things or actions in a certain order or pattern according to a specific rule or set of rules (e.g., patterns of numbers, letters, words, pictures, mathematical operations).

Mathematical Reasoning: The ability to choose the right mathematical methods or formulas to solve a problem.

Mental Stamina: The ability to sustain prolonged mental effort.

Numerical Reasoning: The ability to add, subtract, multiply, divide, and perform other basic numerical calculations correctly.

Speed of Closure: The ability to quickly make sense of, combine, and organize information into meaningful patterns.

Verbal Reasoning: The ability to think and reason with words; the ability to reason out ideas expressed in words.

Knowledge

Mathematics: Knowledge of arithmetic, algebra, geometry, calculus, trigonometry, statistics, and other mathematical disciplines and their applications.

Computer (Data Analysis and Visualisation): Skills in using SPSS, SAS, SAP Hana, IBM Cognos, MATLAB, Minitab, Google Analytics, RapidMiner, R, Apache Hadoop, Apache Spark, Tableau, Visual Basic, etc.

Other tools: Python/ SQL/ UML/ Microsoft Visio/ similar tools.

Skills

Critical Thinking: Skills in analysis of complex situations, using of logic and reasoning to understand the situations and take appropriate actions or make interpretations and inferences.

Judgment and Decision Making: Skills in considering pros and cons of various decision alternatives; considering costs and benefits; taking appropriate and suitable decisions.

Problem Solving: Skills in analysis and understanding of problems, evaluating various options to solve the problems and using the best option to solve the problems.

Reading Comprehension: Skills in understanding written sentences and paragraphs in work related documents.

Personality

You are always imaginative or in most situations.

You always prefer to experience new things and have new experiences or you mostly do.

You can always act independently or could do so in most situations.

You are somewhat organised in your day-to-day life and activities.

You are somewhat careful about your actions and behaviour.

You are somewhat disciplined in your action and behaviour.

You remain calm in difficult situations sometimes but some other times you are anxious.

You are self-satisfied sometimes but some other times you don't feel satisfied with your life and situations.