Apprendre Challenge: Clean and Standardize Department Names | Automating Government Workflows with Python

When working with government records, inconsistencies in department names can have a significant impact on your ability to analyze and report on data accurately. If department names are entered with different capitalization, extra spaces, or other variations, it becomes difficult to group, summarize, or compare records correctly. For instance, Health Department, health department, and HEALTH DEPARTMENT might all refer to the same entity, but automated analysis would treat them as separate categories. This can lead to misleading results and additional manual work to clean up the data before performing meaningful analysis.


              1234567891011
            
# Example dataset with inconsistent department names
records = [
    {"id": 1, "department": "health department "},
    {"id": 2, "department": "  Education Department"},
    {"id": 3, "department": "TRANSPORTATION department"},
    {"id": 4, "department": "public safety"},
    {"id": 5, "department": "Health Department"},
    {"id": 6, "department": " education department"},
    {"id": 7, "department": "Public Safety "},
    {"id": 8, "department": "TRANSPORTATION DEPARTMENT"},
]

To address these inconsistencies, you can use Python's string methods to clean and standardize text fields. The strip() method removes leading and trailing whitespace, which is useful when entries have extra spaces at the beginning or end. The title() method converts a string so that each word starts with an uppercase letter and the rest are lowercase, making capitalization consistent. By combining these methods, you can ensure that department names are formatted uniformly across your dataset, which improves the quality and reliability of your analysis.

Tâche

Swipe to start coding

Write a function that returns a new list of records with all department names standardized to title case and with no leading or trailing spaces.

For each record in records, create a copy of the record.
Modify the department field in the copy so that it has no leading or trailing spaces and each word is capitalized.
Add the modified record to the new list.
Return the new list with cleaned records.

Solution

Tout était clair ?

Merci pour vos commentaires !

Section 3. Chapitre 7

single

Demandez à l'IA

Posez n'importe quelle question ou essayez l'une des questions suggérées pour commencer notre discussion

Glissez pour afficher le menu


              1234567891011
            
# Example dataset with inconsistent department names
records = [
    {"id": 1, "department": "health department "},
    {"id": 2, "department": "  Education Department"},
    {"id": 3, "department": "TRANSPORTATION department"},
    {"id": 4, "department": "public safety"},
    {"id": 5, "department": "Health Department"},
    {"id": 6, "department": " education department"},
    {"id": 7, "department": "Public Safety "},
    {"id": 8, "department": "TRANSPORTATION DEPARTMENT"},
]