To remove the duplicate rows, simply use function `drop_duplicates()`. To change the current dataframe, add `inplace=True`.

new_data = data.drop_duplicates() # data is not modified
# or
data.drop_duplicates(inplace=True) # data is modified

Preprocessing Data is an important step in the process of analyzing data and ML problem-solving. Preparing, cleaning, and scaling data can help to make the process easier and faster. Data preprocessing is a vast area: there are various methods and approaches, and in this course, you'll learn the main ones.

Take a look at the data you are working with first.

Learn how to deal with wrong, undefined or missing values and not lose important ones.

Prepare the data for being the machine-readable and easily interpreted.

Removing Duplicates

Ratkaisu