course content

Course Content

Advanced Techniques in pandas

1. Get Familiar With Indexing and Selecting Data

Output Columns by TitleOutput Rows by IndexSelect Specific Rows and ColumnsLearn More About IndexationGet Familiar With lambda FunctionsExpand Functionality of the .iloc[] Function

2. Dealing With Conditions

Set ConditionChallenge 1Dealing With Several ConditionsMake Your Code BeautifulChallenge 2

3. Extract Data

Is Data in ...?Combine Your KnowledgeBetween FunctionChallengeFind the Smallest Values of a ColumnFind the Largest Values of a ColumnFind the Correlation

4. Aggregating Data

Get Familiar With the .groupby() MethodGroup by Several ColumnsComplicated GroupingGroupDealing With Pivot TablesChallenge

5. Preprocessing Data

Check for Missing ValuesCalculate the Number of Missing ValuesWhat Will We Do With the NaN Values?How to Delete Only NaN Values?Fill In the Missing ValuesManage Categorical VariablesCheck the Column TypeManage an Incorrect ColumnRename the Column

Advanced Techniques in pandas

Get Familiar With lambda FunctionsGet Familiar With lambda Functions

Sometimes we need to put some conditions on the indices. In these cases, you need to use a lambda function inside iloc[].

Let's figure out what we can do using lambda:

This code will output the first five rows of the dataset, the rows with the indices 0, 1, 2, 3, and 4.

  • lambda x - x is the argument we will work with (the item of the data set);
  • x.index - extracts only values of rows' indices;
  • x.index < 5 - the condition according to which we will extract data. Here, only rows with indices that are less than 5.

Task

Your task here is to divide data into two groups: one has odd indices and the other even. Follow the algorithm:

  1. Import the pandas library with the pd alias.
  2. Read the csv file.
  3. Extract only rows with even indices:
    • Apply the .iloc[] function to the data.
    • Within the .iloc[] function, apply the lambda function with the x argument.
    • Set a condition to check if the number is even (if you do not know how to do this, check the hint)
  4. Extract only rows with odd indices:
    • Apply the .iloc[] function to the data.
    • Within the .iloc[] function, apply the lambda function with the x argument.
    • Set a condition to check if the number is odd (if you do not know how to do this, check the hint)
  5. Output data:
    • Output the first five rows of the even indices.
    • Output the last five rows of the odd indices.

Everything was clear?

Section 1. Chapter 5
toggle bottom row