Problem1 Statement:

A wholesale distributor operating in different regions of Portugal has information on annual spending of
several items in their stores across different regions and channels. The data consists of 440 large
retailers’ annual spending on 6 different varieties of products in 3 different regions (Lisbon, Oporto,
Other) and across different sales channel (Hotel, Retail).

Basic EDA
 The data has 440 instances with 9 attributes. 7 integer type and 2 object type (Strings in the column) as
evident from the below result.

 There are no null values in any of the column which is evident from the below result.
  Dataset has 9 variables Buyer/Spender', 'Channel', 'Region', 'Fresh', 'Milk', 'Grocery', 'Frozen',
'Detergents_Paper’ and 'Delicatessen'. Channel and Region both are categorical columns while all the
others are integer type.

1.1 Use methods of descriptive statistics to summarize data. Which Region

and which Channel seems to spend more? Which Region and which
Channel seems to spend less?
The Following table is derived using Descriptive Statistics to summarize the data.

Region Spending (‘ Other is highest and Oporto is least’)

Channel Spending (“Hotel is higher and Retail is least”)

The above table represents the Region wise distribution of Total Spending of all the food Items. Here it
can be seen that spending is spread across three regions Lisbon, Oporto and Other Region.

The below Bar plot represents the Total Spending of all the regions.
 From the above plot it can be concluded that the region Other has the Highest spending and the region
Oporto has the lowest spending

The above table represents the Channel wise distribution of Total Spending of all the food Items. Here it can
be seen that spending is spread across two Channels Hotel and Retail..
The below Bar plot represents the Total Spending of both the Channels.

It can be concluded that the Channel Hotel has the Highest spending and the the Channel Retail
has the lowest spending.

1.2 There are 6 different varieties of items are considered. Do all varieties
show similar behavior across Region and Channel? Provide justification
for your answer.
 There are 6 different varieties of items, Fresh, Milk, Grocery, Frozen, Detergents_Paper, Delicatessen
And it it quite clear from the data representation that all the varieties having different behavior in
region and channel respectively.

1.3 On the basis of a descriptive measure of variability, which item shows the
most inconsistent behavior? Which items show the least inconsistent
behavior?

The above table represents the descriptive statistics of all the six Food Items Fresh,Milk,Grocery, Frozen,
Detergents_Paper and Delicatessen.
Here the consistency of any food item can be calculated using the Coefficient of Variance (CV). The higher
the coefficient of variation, the greater the level of inconsistency and vice versa.

It is derived from the formula as follows:

Coefficient of Variance (CV) = μ/σ

where:
σ = standard deviation
μ = mean

The above pylab grid represents the Coefficient of Variance of all the Food Items. From the Plot it is
evident that Coefficient of Variance is highest for Item Delicatessen and lowest for Item Fresh.
Hence it can be concluded that the item that shows the most inconsistent behavior is Delicatessen, and the
items show the least inconsistent behavior is Fresh.
1.4 Are there any outliers in the data?

To determine the presence of Outliers in the Data the best method is creating Box plot of all the variables as
shown below.
 From the Box plots of all the Variables as above it can be concluded that Yes, There are outliers in the Data.
Outliers are present in the variables Fresh, Milk, Grocery, Frozen, Detergents_Paper and
Delicatessen.

1.5 On the basis of your analysis, what are your recommendations for the
business? How can your analysis help the business to solve its problem?
Answer from the business perspective.

On the basis of the analysis the following recommendations can be made:

 On the basis of the analysis, it can be seen that the region Other and the channel Retail have Higher
spending than other Channel and Regions. Hence From the Business perspective if a new business is to
be opened it Should be opened in the other region with Channel Retail as the Other region is
absorbing maximum amount of sells and this can boast up the Revenue compared to opening a new
business in Lisbon or Oporto and with the Channel Hotel.

 In all the regions the Foot Items Fresh has the highest spending followed by Grocery and Milk.
Hence these food products are strongly recommended to be available simultaneously at all the
businesses with priority of availability being Fresh food products.

 Also, the food item Delicatessen shows least inconsistent behavior across all regions and channels.
So, Delicatessen is also recommended to be always available in all the Businesses.

Problem 2 :

The Student News Service at Clear Mountain State University (CMSU) has decided to gather data about the
undergraduate students that attend CMSU. CMSU creates and distributes a survey of 14 questions and receives
responses from 62 undergraduates.
The Data is stored in the Survey data set as follows:
2.1 For this data, construct the following contingency tables (Keep
Gender as row variable)

2.1.1 Gender and Major

2.1.2 Gender and Grad Intention

2.1.3 Gender and Employment

2.1.4 Gender and Computer

2.2 Assume that the sample is representative of the population of CMSU.

Based on the data, answer the following question:

2.2.1. What is the probability that a randomly selected CMSU student will
be male?

From all the contingency tables creates it can be seen that.

Total No of Students = 62
Total No of Male = 29
Probability a randomly selected student will be male = Total No of Male / Total No of Male
Hence from the calculations done in Python we conclude that :

The probability that a randomly selected CMSU student will be male is 46.77 %

2.2.2. What is the probability that a randomly selected CMSU student will
be female?

From all the contingency tables creates it can be seen that.

Total No of Students = 62
Total No of Female = 33
Probability a randomly selected student will be male = Total No of Male / Total No of Female

Hence from the calculations done in Python we conclude that :

The probability that a randomly selected CMSU student will be Female is 53.23 %

2.3. Assume that the sample is representative of the population of CMSU.

Based on the data, answer the following question:
2.3.1. Find the conditional probability of different majors among the male
students in CMSU.

Contingency table For Gender and Major :

From all the contingency tables creates it can be seen that.

Probability of Accounting among the male students = 4/29

Probability of CIS among the male students = 1 / 29
Probability of Economics/Finance among the male students = 4 /29
Probability of International Business among the male students = 2/29
Probability of Management among the male students Management = 6/29
Probability of Other among the male students Other = 4/29
Probability of Retailing/Marketing among the male students = 5/29
Probability of Undecided among the male students = 3/29

Hence from the calculations done in Python we conclude that :

The Probability of Accounting among the male students is 13.79%

The Probability of CIS among the male students is 3.45%

The Probability of Economics/Finance among the male students 13.79%

The Probability of International Business among the male students 6.9%

The Probability of Management among the male students Management is 20.69%

The Probability of Other among the male students Other 13.79%

The Probability of Retailing/Marketing among the male students 17.24%

The Probability of Undecided among the male students 10.34%

2.3.2 Find the conditional probability of different majors among the female
students of CMSU.

Contingency table For Gender and Major :

From all the contingency tables creates it can be seen that.

Probability of Accounting among the female students = 3/33

Probability of CIS among the female students = 3/33
Probability of Economics/Finance among the female students = 7/33
Probability of International Business among the female students = 4/33
Probability of Management among the female students Management = 4/33
Probability of Other among the female students Other = 3/33
Probability of Retailing/Marketing among the female students = 9/33
Probability of Undecided among the female students = 0/33

Hence from the calculations done in Python we conclude that :

The Probability of Accounting among the female students is 9.09%

The Probability of CIS among the female students is 9.09%

The Probability of Economics/Finance among the female students 21.21%

The Probability of International Business among the female students 12.12%

The Probability of Management among the female students Management is 12.12%

The Probability of Other among the female students Other 9.09%

The Probability of Retailing/Marketing among the female students 27.27%

The Probability of Undecided among the female students 0%

2.4. Assume that the sample is a representative of the population of CMSU.

Based on the data, answer the following question:

2.4.1. Find the probability That a randomly chosen student is a male and
intends to graduate.
Contingency table For Gender and Grad Intention :

Probability that a randomly chosen student is a Male = 29/62

Probability of Male that intends to Graduate = 17/29

Probability a randomly chosen student is a male and intends to graduate

= Probability that a randomly chosen student is a Male * Probability that a randomly chosen
student is a Male

The probability That a randomly chosen student is a male and intends to graduate is
27.42 %

2.4.2 Find the probability that a randomly selected student is a female and
does NOT have a laptop.
Contingency table For Gender and Computer :

Probability that a randomly chosen student is a Female = 33/62

Probability of Female with No Laptop = 1-(29/33)

Probability that a randomly selected student is a female and does NOT have a laptop
= Probability that a randomly chosen student is a Female * Probability of Female with No
Laptop

The probability that a randomly selected student is a female and does NOT have a
laptop is 6.45 %
2.5. Assume that the sample is representative of the population of CMSU.
Based on the data, answer the following question:

2.5.1. Find the probability that a randomly chosen student is either a male
or has full-time employment?

Contingency table For Gender and Employment :

Probability of a Student being Male = 29/33

Probability of a student having FullTime Employment = 10/62
Probability of a Male having FullTime Employment = 7/29

Probability that a randomly chosen student is either a male or has full-time employment
= Probability of a Student being Male + Probability of a student having FullTime Employment
- Probability of a Male having FullTime Employment
The probability that a randomly chosen student is either a male or has a full-time employment
79.87 %

2.5.2. Find the conditional probability that given a female student is

randomly chosen, she is majoring in international business or
management.

Contingency table For Gender and Employment :

Probability of international business given Female = 4/33

Probability of management given Female = 4/33
Since international business and management are independent of each other

Probability of international business or management given Female

= Probability of international business given Female + Probability of management given
Female

The conditional probability that given a female student is randomly chosen, she is majoring in
international business or management is 24.242 %

2.6. Construct a contingency table of Gender and Intent to Graduate at 2

levels (Yes/No). The Undecided students are not considered now and the
table is a 2x2 table. Do you think the graduate intention and being female
are independent events?

2X2 Contingency table of Gender and Intent to Graduate without considering the Undecided
students

Two events A and B can be proved to be Independent events when it satisfies the condition :

P(A ∩ B) = P(A) * P(B)

In this case if being female and graduate intention are independent can be proven by checking the
condition :

P(F ∩ Yes) = P(F) * P(Yes)

Where F = Female
Yes = Grad Intention being Yes

Hence from the calculations done in Python we conclude that :

P(F ∩ Yes) ≠ P(F) * P(Yes)

Hence, Graduate intention and being female are not independent events
2.7. Note that there are four numerical (continuous) variables in the data
set, GPA, Salary, Spending, and Text Messages.

Answer the following questions based on the data

2.6.1. If a student is chosen randomly, what is the probability that his/her

GPA is less than 3?

Since GPA is a continuous variable the Probability of a student whose GPA is less than 3 an be calculated by
using the Poisson Distribution.

To calculate the probability of GPA 3 or less we will add the prob of 0,1,2 and 3 GPA obtained in the Poisson
Distribution.

Hence from the calculations done in Python we conclude that :

If a student is chosen randomly, what is the probability that his/her GPA is less than 3
is 39.49%

2.6.2. Find the conditional probability that a randomly selected male earns
50 or more. Find the conditional probability that a randomly selected
female earns 50 or more.

Conditional probability that a randomly selected male earns 50 or more:

The above distplot represents the salary of all the Male in the population.
As we can see it is normally distributed hence the conditional probability that a randomly selected male earns
50 or more can be calculated using the Normal distribution.

To calculate this, we will calculate the cumulative probability for less than 50 using Normal Distribution and
then will subtract from 1.

Hence from the calculations done in Python we conclude that :

The Conditional probability that a randomly selected male earns 50 or more is 83.04 %

Conditional probability that a randomly selected female earns 50 or more:

The above distplot represents the salary of all the Female in the population.

As we can see it is normally distributed hence the conditional probability that a randomly selected female earns
50 or more can be calculated using the Normal distribution.

To calculate this, we will calculate the cumulative probability for less than 50 using Normal Distribution and
then will subtract from 1.

Hence from the calculations done in Python we conclude that :

The Conditional probability that a randomly selected Female earns 50 or more is

86.09 %

2.8. Note that there are four numerical (continuous) variables in the data
set, GPA, Salary, Spending, and Text Messages. For each of them comment
whether they follow a normal distribution. Write a note summarizing your
conclusions.

From the above histograms for the continuous variables GPA, Salary, Spending and Text Messages we
can see that :
 GPA is almost Normally Distributed with a slight skewness toward the left.
 Salary is also Normally Distributed with a slight skewness towards the right.
 Spending is not Normally distributed and highly Right Skewed
 Text message is not Normally distributed and highly Right Skewed.

The following table consist of the Skewness value of the variables.

As mentioned earlier from the Table it is evident that:
 GPA has very less Skewness and it is negative, so it is towards the left.
 Salary also has very less skewness but positive, so it is towards the right.
 Spending is highly Right Skewed
 Text Message is highly Right Skewed.

Problem 3
An important quality characteristic used by the manufacturers of ABC asphalt shingles is the amount
of moisture the shingles contain when they are packaged. Customers may feel that they have
purchased a product lacking in quality if they find moisture and wet shingles inside the packaging. In
some cases, excessive moisture can cause the granules attached to the shingles for texture and
coloring purposes to fall off the shingles resulting in appearance problems. To monitor the amount of
moisture present, the company conducts moisture tests. A shingle is weighed and then dried. The
shingle is then reweighed and based on the amount of moisture taken out of the product, the pounds
of moisture per 100 square feet is calculated. The company would like to show that the mean moisture
content is less than 0.35 pound per 100 square feet.

The file (A & B shingles.csv) includes 36 measurements (in pounds per 100 square feet) for A shingles
and 31 for B shingles.
3.1 Do you think there is evidence that means moisture contents in both
types of shingles are within the permissible limits? State your conclusions
clearly showing all steps.

For the A shingles, the null and alternative hypothesis to test whether the population mean moisture content is
less than 0.35 pound per 100 square feet is given:

H0 : mean moisture content <=0.35

HA : mean moisture content > 0.35

Level of significance: 0.05

We have a samples and we do not know the population standard deviation.

The sample is not a large sample. So you use the t distribution and the tSTAT test statistic

Since we a testing for only sample A we use One sample T test. Also as python by default in
Python, ttest_1samp shows the result of 2-sided it is divided by 2 as our is a !_Sided test.

Hence from the calculations done in Python we conclude that :

Our one-sample t-test p-value= [0.07477633]

We have no evidence to reject the null hypothesis since p value > Level of significance

For the B shingles, the null and alternative hypothesis to test whether the population mean moisture content is
less than 0.35 pound per 100 square feet is given:

H0 : mean moisture content <=0.35

HA : mean moisture content > 0.35

Level of significance: 0.05

We have a samples and we do not know the population standard deviation.

The sample is not a large sample. So you use the t distribution and the tSTAT test statistic

Since we a testing for only sample A we use One sample T test. . Also as python by default in
Python, ttest_1samp shows the result of 2-sided it is divided by 2 as our is a !_Sided test.

Hence from the calculations done in Python we conclude that :

Our one-sample t-test p-value= [0.0020904774003191826]

We have evidence to reject the null hypothesis since p value < Level of significance

3.2 Do you think that the population mean for shingles A and B are equal?
Form the hypothesis and conduct the test of the hypothesis. What
assumption do you need to check before the test for equality of means is
performed?

Theoretical Assumptions for the Hypothesis Testing :

To perform a Test of equality of the population mean of the A shingles and B shingles, the null and alternative
hypothesis to test whether the population mean moisture content is equal is given:

H0 : mean moisture content of A = mean moisture content of B

HA : mean moisture content of A ≠ mean moisture content of B

Level of significance: 0.05

We have two samples A and B and we do not know the population standard deviation.

The samples are not large sample. So you use the t distribution and the tSTAT test statistic

Since we a testing for equality between sample A and B we use two sample T test.

Hence from the calculations done in Python we conclude that :

Two-sample t-test p-value= 0.2017496571835306

We do not have enough evidence to reject the null hypothesis in favour of alternative
hypothesis since p value > Level of significance

Therefore, It can be concluded that the population mean for shingles A and B are equal.