{"id":22612981,"url":"https://github.com/leonism/breast-cancer","last_synced_at":"2026-05-06T07:31:34.482Z","repository":{"id":96669501,"uuid":"274543583","full_name":"leonism/Breast-Cancer","owner":"leonism","description":"How to predict a Breast Cancer patient through Machine Learning modeling with Python, using Pandas, Numpy and SciKit-Learn Libraries","archived":false,"fork":false,"pushed_at":"2024-08-16T04:04:49.000Z","size":6571,"stargazers_count":0,"open_issues_count":0,"forks_count":0,"subscribers_count":1,"default_branch":"master","last_synced_at":"2025-03-28T23:46:50.264Z","etag":null,"topics":["data-science","machine-learning","machinelearning","python"],"latest_commit_sha":null,"homepage":"https://leonism.github.io/Breast-Cancer/","language":"Jupyter Notebook","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/leonism.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2020-06-24T01:13:03.000Z","updated_at":"2024-08-16T04:04:52.000Z","dependencies_parsed_at":null,"dependency_job_id":"59cbb351-8429-423a-b349-37549658cb10","html_url":"https://github.com/leonism/Breast-Cancer","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"purl":"pkg:github/leonism/Breast-Cancer","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/leonism%2FBreast-Cancer","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/leonism%2FBreast-Cancer/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/leonism%2FBreast-Cancer/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/leonism%2FBreast-Cancer/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/leonism","download_url":"https://codeload.github.com/leonism/Breast-Cancer/tar.gz/refs/heads/master","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/leonism%2FBreast-Cancer/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":286080680,"owners_count":32683694,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2026-05-06T02:33:58.958Z","status":"ssl_error","status_checked_at":"2026-05-06T02:33:39.611Z","response_time":117,"last_error":"SSL_connect returned=1 errno=0 peeraddr=140.82.121.5:443 state=error: unexpected eof while reading","robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":false,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["data-science","machine-learning","machinelearning","python"],"created_at":"2024-12-08T17:14:42.185Z","updated_at":"2026-05-06T07:31:34.453Z","avatar_url":"https://github.com/leonism.png","language":"Jupyter Notebook","funding_links":[],"categories":[],"sub_categories":[],"readme":"# Predicting Breast Cancer Using Machine Learning\n\n![header-main.jpg](images/predicting-breast-cancer-using-machine-learning.png)\n\n---\n\nImagine harnessing the power of machine learning to predict one of the most prevalent and life-threatening diseases: breast cancer. As data science enthusiasts, we often seek new challenges to expand our skills and dive into unexplored territories. This journey not only enhances our technical prowess but also broadens our understanding of diverse fields.\n\nThis article invites you to venture beyond the realms of `digital marketing` and `media investment` into the captivating world of `healthcare`. Did you know that cancer is the second leading cause of death globally, accounting for approximately 9.6 million deaths in 2018, according to the [WHO](https://www.who.int/news-room/fact-sheets/detail/cancer#:~:text=Cancer%20is%20the%20second%20leading,-%20and%20middle-income%20countries.). This staggering statistic underscores the urgent need for innovative solutions in early detection and treatment.\n\nJoin me as we explore how machine learning can be a game-changer in predicting breast cancer symptoms. We'll utilize a comprehensive dataset from [UCI](https://archive.ics.uci.edu/ml/datasets/breast+cancer+wisconsin+%28original%29), generously provided by academicians, to build our predictive model.\n\nTo bring this vision to life, we'll employ powerful Python libraries like [Pandas](https://pandas.pydata.org/), [Seaborn](https://seaborn.pydata.org/), and [Scikit-learn](https://scikit-learn.org/). These tools will help us explore, clean, and visualize data, ultimately leading to a robust machine learning model. Ready to embark on this exciting adventure? Let's break it down into manageable steps:\n\n1. **Loading Libraries**\n2. **Data Exploration**\n3. **Data Visualization**\n4. **One Hot Encoding**\n5. **Feature Generation**\n6. **Data Splitting**\n7. **Machine Learning Modeling**\n8. **Data Prediction**\n\nDive in and discover how you can leverage machine learning to make a meaningful impact in the fight against breast cancer.\n\n---\n\n# 1. Load Libraries\n\nMuch like any other data exploratory process in Pandas or Python, the initial phase involves loading the essential libraries into our working Jupyter Notebook environment. These libraries are the backbone of our data analysis and machine learning endeavors, providing us with the tools needed to manipulate, visualize, and model our data. Whether you're using `Jupyter Notebook`, `Google Colab`, or `Kaggle`, the process remains largely the same. These platforms offer robust environments that support Python and its libraries, making them ideal for data science projects.\n\nFor this tutorial, I'll stick to my faithful Jupyter Notebook environment, known for its versatility and user-friendly interface. Jupyter Notebook allows for an interactive data analysis experience, where code, visualizations, and explanatory text can coexist seamlessly. This setup will enable us to document our process comprehensively and adjust our code on the fly as we delve into the breast cancer dataset. While you're free to use any Integrated Development Environment (IDE) you prefer, Jupyter Notebook's integration with libraries like `Pandas`, `Seaborn`, and `Scikit-learn` makes it an excellent choice for this step-by-step guide.\n\n```python\nimport numpy as np # linear algebra\nimport pandas as pd # data processing, CSV file I/O (e.g. pd.read_csv)\nimport seaborn as sns # visualization library\n```\n\n## 1.1 Load Dataset\n\nStart by creating a directory on your computer. Although I'm using a MacOS environment, the instructions provided here are applicable across different platforms. For the purpose of this walkthrough, let's name the directory `Project`. This will serve as our main working directory. Navigate into the `Project` folder, as this will be our base for organizing and executing the steps outlined in this tutorial. The next step is to download the breast cancer dataset from the [UCI](https://archive.ics.uci.edu/ml/datasets/breast+cancer+wisconsin+%28original%29) site, which we'll use for our machine learning model.\n\nWithin the `Project` directory, create a new folder named `data` and copy the downloaded CSV file into this `data` directory. This organization ensures that all relevant files are neatly stored and easily accessible throughout the tutorial. By structuring our project this way, we facilitate a smooth workflow and maintain order as we progress. Now that everything is set up, we can load the dataset into our Jupyter Notebook. This step allows us to examine, manipulate, and observe the data, laying the groundwork for our machine learning exploration.\n\n```python\ndf = pd.read_csv('data/breast_cancer_data.csv')\n```\n\n---\n\n## 1.2 Dataset Size\n\nOnce we have completed the initial setup, we can proceed to analyze our dataset further. A common starting point in any data analysis project is to understand the size of the dataset. You might be wondering, just how large is our dataset? This question is easily answered using the `.shape` method in Pandas.\n\nBy applying the `.shape` method to our dataset, we can quickly obtain the number of rows and columns. This method returns a tuple representing the dimensions of the dataset, giving us an immediate sense of its scale. Understanding the size of our dataset is crucial as it informs us about the volume of data we will be working with and helps in planning subsequent data processing and analysis steps.\n\n```python\ndf.shape\n```\n\n (699, 12)\n\n### Rows \u0026 Columns\n\nWe can see we have the following information at hand:\n\n- rows `699`\n- columns `12`\n\n## 1.3 Data Types\n\nIt's always a good idea to get cozy with our dataset, not just by looking at its size, but by understanding what it's really made of. Think of it like getting to know a new friend—you wouldn't just ask them how tall they are, right? You'd want to know their quirks, their traits, what makes them tick. The same goes for our data. Knowing the types of data in each column helps us groove through the feature generation phase with ease.\n\nSo, let's kick back and take a deeper dive. By checking out the data types of each column, we get the full picture: the numbers, the categories, the text. This insight is like the smooth rhythm of a jazz tune, guiding us to apply the right transformations and manipulations. When we're in sync with our data, everything just flows better, leading to more accurate and reliable models. To get this vibe going, we'll use the `.dtypes` attribute in Pandas. It’s our backstage pass to the inner workings of the dataset, giving us a clear overview of the structure and content. Let's get jazzy with our data and see what it’s composed of!\n\n```python\n# We need to observe the data types of each columns\ndf.dtypes\n```\n\n patient_id int64\n clump_thickness float64\n cell_size_uniformity float64\n cell_shape_uniformity int64\n marginal_adhesion int64\n single_ep_cell_size int64\n bare_nuclei object\n bland_chromatin float64\n normal_nucleoli float64\n mitoses int64\n class object\n doctor_name object\n dtype: object\n\n### 1.3.1 The Data Legend\n\nLet's lay down the smooth beats of our dataset. Here's the lowdown on the columns we have, as described by the source:\n\n- `Patient ID`: id number\n- `Clump Thickness`: 1–10\n- `Uniformity of Cell Size`: 1–10\n- `Uniformity of Cell Shape`: 1–10\n- `Marginal Adhesion`: 1–10\n- `Single Epithelial Cell Size`: 1–10\n- `Bare Nuclei`: 1–10\n- `Bland Chromatin`: 1–10\n- `Normal Nucleoli`: 1–10\n- `Mitoses`: 1–10\n- `Class`: malignant or benign\n- `Doctor name`: 4 different doctors\n\nSo, what’s the vibe here? The `Patient ID` is our unique identifier, ensuring each record stands out. The `Class` column is the headline act, telling us whether the tumor is `malignant` (cancerous) or `benign` (not cancerous). The rest of the columns? They're numeric medical descriptions of the tumor, except for `Doctor name`, which adds a categorical twist.\n\n\u003e Keep this in mind—if our goal is to predict whether a tumor is cancerous based on the other features, we’ll need to perform some one-hot encoding on the categorical data and clean up the numerical data. Just like tuning an instrument before a jam session, prepping our data ensures everything flows smoothly in our analysis.\n\n### 1.3.2 First \u0026 Last Rows\n\nNow that we've got the lay of the land, let's dive in and see what the top five records in our dataset look like. This peek at the first few rows will give us a quick feel for the data and help us spot any obvious issues or patterns right off the bat.\n\nTo do this, we'll use the `.head()` method in Pandas, which will show us the first five rows. It's like getting a sneak preview of the opening act before the main event. This simple step is crucial for ensuring we're on the right track and that our data is ready to roll.\n\n```python\ndf.head()\n```\n\n\u003cdiv\u003e\n\u003cstyle scoped\u003e\n .dataframe tbody tr th:only-of-type {\n vertical-align: middle;\n }\n .dataframe tbody tr th {\n vertical-align: top;\n }\n .dataframe thead th {\n text-align: right;\n }\n\u003c/style\u003e\n\u003ctable border=\"1\" class=\"dataframe\"\u003e\n \u003cthead\u003e\n \u003ctr style=\"text-align: right;\"\u003e\n \u003cth\u003e\u003c/th\u003e\n \u003cth\u003epatient_id\u003c/th\u003e\n \u003cth\u003eclump_thickness\u003c/th\u003e\n \u003cth\u003ecell_size_uniformity\u003c/th\u003e\n \u003cth\u003ecell_shape_uniformity\u003c/th\u003e\n \u003cth\u003emarginal_adhesion\u003c/th\u003e\n \u003cth\u003esingle_ep_cell_size\u003c/th\u003e\n \u003cth\u003ebare_nuclei\u003c/th\u003e\n \u003cth\u003ebland_chromatin\u003c/th\u003e\n \u003cth\u003enormal_nucleoli\u003c/th\u003e\n \u003cth\u003emitoses\u003c/th\u003e\n \u003cth\u003eclass\u003c/th\u003e\n \u003cth\u003edoctor_name\u003c/th\u003e\n \u003c/tr\u003e\n \u003c/thead\u003e\n \u003ctbody\u003e\n \u003ctr\u003e\n \u003cth\u003e0\u003c/th\u003e\n \u003ctd\u003e1000025\u003c/td\u003e\n \u003ctd\u003e5.0\u003c/td\u003e\n \u003ctd\u003e1.0\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003e2\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003e3.0\u003c/td\u003e\n \u003ctd\u003e1.0\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003ebenign\u003c/td\u003e\n \u003ctd\u003eDr. Doe\u003c/td\u003e\n \u003c/tr\u003e\n \u003ctr\u003e\n \u003cth\u003e1\u003c/th\u003e\n \u003ctd\u003e1002945\u003c/td\u003e\n \u003ctd\u003e5.0\u003c/td\u003e\n \u003ctd\u003e4.0\u003c/td\u003e\n \u003ctd\u003e4\u003c/td\u003e\n \u003ctd\u003e5\u003c/td\u003e\n \u003ctd\u003e7\u003c/td\u003e\n \u003ctd\u003e10\u003c/td\u003e\n \u003ctd\u003e3.0\u003c/td\u003e\n \u003ctd\u003e2.0\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003ebenign\u003c/td\u003e\n \u003ctd\u003eDr. Smith\u003c/td\u003e\n \u003c/tr\u003e\n \u003ctr\u003e\n \u003cth\u003e2\u003c/th\u003e\n \u003ctd\u003e1015425\u003c/td\u003e\n \u003ctd\u003e3.0\u003c/td\u003e\n \u003ctd\u003e1.0\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003e2\u003c/td\u003e\n \u003ctd\u003e2\u003c/td\u003e\n \u003ctd\u003e3.0\u003c/td\u003e\n \u003ctd\u003e1.0\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003ebenign\u003c/td\u003e\n \u003ctd\u003eDr. Lee\u003c/td\u003e\n \u003c/tr\u003e\n \u003ctr\u003e\n \u003cth\u003e3\u003c/th\u003e\n \u003ctd\u003e1016277\u003c/td\u003e\n \u003ctd\u003e6.0\u003c/td\u003e\n \u003ctd\u003e8.0\u003c/td\u003e\n \u003ctd\u003e8\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003e3\u003c/td\u003e\n \u003ctd\u003e4\u003c/td\u003e\n \u003ctd\u003e3.0\u003c/td\u003e\n \u003ctd\u003e7.0\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003ebenign\u003c/td\u003e\n \u003ctd\u003eDr. Smith\u003c/td\u003e\n \u003c/tr\u003e\n \u003ctr\u003e\n \u003cth\u003e4\u003c/th\u003e\n \u003ctd\u003e1017023\u003c/td\u003e\n \u003ctd\u003e4.0\u003c/td\u003e\n \u003ctd\u003e1.0\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003e3\u003c/td\u003e\n \u003ctd\u003e2\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003e3.0\u003c/td\u003e\n \u003ctd\u003e1.0\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003ebenign\u003c/td\u003e\n \u003ctd\u003eDr. Wong\u003c/td\u003e\n \u003c/tr\u003e\n \u003c/tbody\u003e\n\u003c/table\u003e\n\u003c/div\u003e\n\nAdditionally, checking the last few records with the `.tail()` method will give us a complete sense of the dataset's structure. This combination of the first and last rows provides a balanced overview, ensuring no surprises lurk at the end. Let's groove through the data and see what stories the top and bottom rows tell us!\n\n```python\ndf.tail()\n```\n\n\u003cdiv\u003e\n\u003cstyle scoped\u003e\n .dataframe tbody tr th:only-of-type {\n vertical-align: middle;\n }\n\n .dataframe tbody tr th {\n vertical-align: top;\n }\n\n .dataframe thead th {\n text-align: right;\n }\n\n\u003c/style\u003e\n\u003ctable border=\"1\" class=\"dataframe\"\u003e\n \u003cthead\u003e\n \u003ctr style=\"text-align: right;\"\u003e\n \u003cth\u003e\u003c/th\u003e\n \u003cth\u003epatient_id\u003c/th\u003e\n \u003cth\u003eclump_thickness\u003c/th\u003e\n \u003cth\u003ecell_size_uniformity\u003c/th\u003e\n \u003cth\u003ecell_shape_uniformity\u003c/th\u003e\n \u003cth\u003emarginal_adhesion\u003c/th\u003e\n \u003cth\u003esingle_ep_cell_size\u003c/th\u003e\n \u003cth\u003ebare_nuclei\u003c/th\u003e\n \u003cth\u003ebland_chromatin\u003c/th\u003e\n \u003cth\u003enormal_nucleoli\u003c/th\u003e\n \u003cth\u003emitoses\u003c/th\u003e\n \u003cth\u003eclass\u003c/th\u003e\n \u003cth\u003edoctor_name\u003c/th\u003e\n \u003c/tr\u003e\n \u003c/thead\u003e\n \u003ctbody\u003e\n \u003ctr\u003e\n \u003cth\u003e694\u003c/th\u003e\n \u003ctd\u003e776715\u003c/td\u003e\n \u003ctd\u003e3.0\u003c/td\u003e\n \u003ctd\u003e1.0\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003e3\u003c/td\u003e\n \u003ctd\u003e2\u003c/td\u003e\n \u003ctd\u003e1.0\u003c/td\u003e\n \u003ctd\u003e1.0\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003ebenign\u003c/td\u003e\n \u003ctd\u003eDr. Lee\u003c/td\u003e\n \u003c/tr\u003e\n \u003ctr\u003e\n \u003cth\u003e695\u003c/th\u003e\n \u003ctd\u003e841769\u003c/td\u003e\n \u003ctd\u003e2.0\u003c/td\u003e\n \u003ctd\u003e1.0\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003e2\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003e1.0\u003c/td\u003e\n \u003ctd\u003e1.0\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003ebenign\u003c/td\u003e\n \u003ctd\u003eDr. Smith\u003c/td\u003e\n \u003c/tr\u003e\n \u003ctr\u003e\n \u003cth\u003e696\u003c/th\u003e\n \u003ctd\u003e888820\u003c/td\u003e\n \u003ctd\u003e5.0\u003c/td\u003e\n \u003ctd\u003e10.0\u003c/td\u003e\n \u003ctd\u003e10\u003c/td\u003e\n \u003ctd\u003e3\u003c/td\u003e\n \u003ctd\u003e7\u003c/td\u003e\n \u003ctd\u003e3\u003c/td\u003e\n \u003ctd\u003e8.0\u003c/td\u003e\n \u003ctd\u003e10.0\u003c/td\u003e\n \u003ctd\u003e2\u003c/td\u003e\n \u003ctd\u003emalignant\u003c/td\u003e\n \u003ctd\u003eDr. Lee\u003c/td\u003e\n \u003c/tr\u003e\n \u003ctr\u003e\n \u003cth\u003e697\u003c/th\u003e\n \u003ctd\u003e897471\u003c/td\u003e\n \u003ctd\u003e4.0\u003c/td\u003e\n \u003ctd\u003e8.0\u003c/td\u003e\n \u003ctd\u003e6\u003c/td\u003e\n \u003ctd\u003e4\u003c/td\u003e\n \u003ctd\u003e3\u003c/td\u003e\n \u003ctd\u003e4\u003c/td\u003e\n \u003ctd\u003e10.0\u003c/td\u003e\n \u003ctd\u003e6.0\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003emalignant\u003c/td\u003e\n \u003ctd\u003eDr. Lee\u003c/td\u003e\n \u003c/tr\u003e\n \u003ctr\u003e\n \u003cth\u003e698\u003c/th\u003e\n \u003ctd\u003e897471\u003c/td\u003e\n \u003ctd\u003e4.0\u003c/td\u003e\n \u003ctd\u003e8.0\u003c/td\u003e\n \u003ctd\u003e8\u003c/td\u003e\n \u003ctd\u003e5\u003c/td\u003e\n \u003ctd\u003e4\u003c/td\u003e\n \u003ctd\u003e5\u003c/td\u003e\n \u003ctd\u003e10.0\u003c/td\u003e\n \u003ctd\u003e4.0\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003emalignant\u003c/td\u003e\n \u003ctd\u003eDr. Wong\u003c/td\u003e\n \u003c/tr\u003e\n \u003c/tbody\u003e\n\u003c/table\u003e\n\u003c/div\u003e\n\n\u003chr /\u003e\n\n# 2. Descriptive Statistics\n\nIn Descriptive statistics, we are describing our data with the help of various representative methods using `charts`, `graphs`, `tables`, `excel files`, etc. In descriptive statistics, we describe our data in some manner and present it in a meaningful way so that it can be easily understood. Most of the time it is performed on small data sets and this analysis helps us a lot to predict some future trends based on the current findings. Some measures that are used to describe a data set are measures of central tendency and measures of variability or dispersion.\n\n## 2.1 Numerical Analysis\n\nLet's jazz up our dataset with some sweet statistical insights! With the `.describe()` method, we're about to dive deep into the numerical nitty-gritty. This little trick gives us the lowdown on key stats like `count`, `mean`, and `standard deviation`, shedding light on the distribution and central tendencies of our numeric data.\n\nSo, why does this matter? Well, getting cozy with these numbers gives us a clearer picture of what we're working with. It's like fine-tuning our instruments before a performance—it ensures our analysis hits all the right notes. With these stats in hand, we can groove through our dataset with confidence, uncovering hidden patterns and trends along the way. Let's crank up the volume and see what the numbers have to say! 🎶\n\n```python\ndf.describe()\n```\n\n\u003cdiv\u003e\n\u003cstyle scoped\u003e\n .dataframe tbody tr th:only-of-type {\n vertical-align: middle;\n }\n .dataframe tbody tr th {\n vertical-align: top;\n }\n .dataframe thead th {\n text-align: right;\n }\n\u003c/style\u003e\n\u003ctable border=\"1\" class=\"dataframe\"\u003e\n \u003cthead\u003e\n \u003ctr style=\"text-align: right;\"\u003e\n \u003cth\u003e\u003c/th\u003e\n \u003cth\u003epatient_id\u003c/th\u003e\n \u003cth\u003eclump_thickness\u003c/th\u003e\n \u003cth\u003ecell_size_uniformity\u003c/th\u003e\n \u003cth\u003ecell_shape_uniformity\u003c/th\u003e\n \u003cth\u003emarginal_adhesion\u003c/th\u003e\n \u003cth\u003esingle_ep_cell_size\u003c/th\u003e\n \u003cth\u003ebland_chromatin\u003c/th\u003e\n \u003cth\u003enormal_nucleoli\u003c/th\u003e\n \u003cth\u003emitoses\u003c/th\u003e\n \u003c/tr\u003e\n \u003c/thead\u003e\n \u003ctbody\u003e\n \u003ctr\u003e\n \u003cth\u003ecount\u003c/th\u003e\n \u003ctd\u003e6.990000e+02\u003c/td\u003e\n \u003ctd\u003e698.000000\u003c/td\u003e\n \u003ctd\u003e698.000000\u003c/td\u003e\n \u003ctd\u003e699.000000\u003c/td\u003e\n \u003ctd\u003e699.000000\u003c/td\u003e\n \u003ctd\u003e699.000000\u003c/td\u003e\n \u003ctd\u003e695.000000\u003c/td\u003e\n \u003ctd\u003e698.000000\u003c/td\u003e\n \u003ctd\u003e699.000000\u003c/td\u003e\n \u003c/tr\u003e\n \u003ctr\u003e\n \u003cth\u003emean\u003c/th\u003e\n \u003ctd\u003e1.071704e+06\u003c/td\u003e\n \u003ctd\u003e4.416905\u003c/td\u003e\n \u003ctd\u003e3.137536\u003c/td\u003e\n \u003ctd\u003e3.207439\u003c/td\u003e\n \u003ctd\u003e2.793991\u003c/td\u003e\n \u003ctd\u003e3.216023\u003c/td\u003e\n \u003ctd\u003e3.447482\u003c/td\u003e\n \u003ctd\u003e2.868195\u003c/td\u003e\n \u003ctd\u003e1.589413\u003c/td\u003e\n \u003c/tr\u003e\n \u003ctr\u003e\n \u003cth\u003estd\u003c/th\u003e\n \u003ctd\u003e6.170957e+05\u003c/td\u003e\n \u003ctd\u003e2.817673\u003c/td\u003e\n \u003ctd\u003e3.052575\u003c/td\u003e\n \u003ctd\u003e2.971913\u003c/td\u003e\n \u003ctd\u003e2.843163\u003c/td\u003e\n \u003ctd\u003e2.214300\u003c/td\u003e\n \u003ctd\u003e2.441191\u003c/td\u003e\n \u003ctd\u003e3.055647\u003c/td\u003e\n \u003ctd\u003e1.715078\u003c/td\u003e\n \u003c/tr\u003e\n \u003ctr\u003e\n \u003cth\u003emin\u003c/th\u003e\n \u003ctd\u003e6.163400e+04\u003c/td\u003e\n \u003ctd\u003e1.000000\u003c/td\u003e\n \u003ctd\u003e1.000000\u003c/td\u003e\n \u003ctd\u003e1.000000\u003c/td\u003e\n \u003ctd\u003e1.000000\u003c/td\u003e\n \u003ctd\u003e1.000000\u003c/td\u003e\n \u003ctd\u003e1.000000\u003c/td\u003e\n \u003ctd\u003e1.000000\u003c/td\u003e\n \u003ctd\u003e1.000000\u003c/td\u003e\n \u003c/tr\u003e\n \u003ctr\u003e\n \u003cth\u003e25%\u003c/th\u003e\n \u003ctd\u003e8.706885e+05\u003c/td\u003e\n \u003ctd\u003e2.000000\u003c/td\u003e\n \u003ctd\u003e1.000000\u003c/td\u003e\n \u003ctd\u003e1.000000\u003c/td\u003e\n \u003ctd\u003e1.000000\u003c/td\u003e\n \u003ctd\u003e2.000000\u003c/td\u003e\n \u003ctd\u003e2.000000\u003c/td\u003e\n \u003ctd\u003e1.000000\u003c/td\u003e\n \u003ctd\u003e1.000000\u003c/td\u003e\n \u003c/tr\u003e\n \u003ctr\u003e\n \u003cth\u003e50%\u003c/th\u003e\n \u003ctd\u003e1.171710e+06\u003c/td\u003e\n \u003ctd\u003e4.000000\u003c/td\u003e\n \u003ctd\u003e1.000000\u003c/td\u003e\n \u003ctd\u003e1.000000\u003c/td\u003e\n \u003ctd\u003e1.000000\u003c/td\u003e\n \u003ctd\u003e2.000000\u003c/td\u003e\n \u003ctd\u003e3.000000\u003c/td\u003e\n \u003ctd\u003e1.000000\u003c/td\u003e\n \u003ctd\u003e1.000000\u003c/td\u003e\n \u003c/tr\u003e\n \u003ctr\u003e\n \u003cth\u003e75%\u003c/th\u003e\n \u003ctd\u003e1.238298e+06\u003c/td\u003e\n \u003ctd\u003e6.000000\u003c/td\u003e\n \u003ctd\u003e5.000000\u003c/td\u003e\n \u003ctd\u003e5.000000\u003c/td\u003e\n \u003ctd\u003e3.500000\u003c/td\u003e\n \u003ctd\u003e4.000000\u003c/td\u003e\n \u003ctd\u003e5.000000\u003c/td\u003e\n \u003ctd\u003e4.000000\u003c/td\u003e\n \u003ctd\u003e1.000000\u003c/td\u003e\n \u003c/tr\u003e\n \u003ctr\u003e\n \u003cth\u003emax\u003c/th\u003e\n \u003ctd\u003e1.345435e+07\u003c/td\u003e\n \u003ctd\u003e10.000000\u003c/td\u003e\n \u003ctd\u003e10.000000\u003c/td\u003e\n \u003ctd\u003e10.000000\u003c/td\u003e\n \u003ctd\u003e10.000000\u003c/td\u003e\n \u003ctd\u003e10.000000\u003c/td\u003e\n \u003ctd\u003e10.000000\u003c/td\u003e\n \u003ctd\u003e10.000000\u003c/td\u003e\n \u003ctd\u003e10.000000\u003c/td\u003e\n \u003c/tr\u003e\n \u003c/tbody\u003e\n\u003c/table\u003e\n\u003c/div\u003e\n\n## 2.2 Categorical Analysis\n\nJust like tuning into a different frequency, let's shift our focus to the categorical side of the spectrum. With the `.describe(include=['O'])` method, we're about to unravel the mysteries of our categorical data. While the output might be a bit more concise compared to its numerical counterpart, it still packs a punch.\n\nBy honing in on the categorical variables—those with a data type of `object`—we gain valuable insights into their distribution and uniqueness. It's like flipping through the pages of a well-worn record collection, each category offering its own distinct vibe.\n\nSo, why bother? Well, understanding the landscape of our categorical data sets the stage for deeper analysis. Just like a DJ crafting the perfect mix, these insights help us blend and remix our data with precision. With the `.describe(include=['O'])` method in hand, we're ready to spin some categorical magic and uncover the stories hidden within our dataset. Let's dive in and see what melodies await! 🎵\n\n```python\ndf.describe(include=['O'])\n```\n\n\u003cdiv\u003e\n\u003cstyle scoped\u003e\n .dataframe tbody tr th:only-of-type {\n vertical-align: middle;\n }\n\n .dataframe tbody tr th {\n vertical-align: top;\n }\n\n .dataframe thead th {\n text-align: right;\n }\n\n\u003c/style\u003e\n\u003ctable border=\"1\" class=\"dataframe\"\u003e\n \u003cthead\u003e\n \u003ctr style=\"text-align: right;\"\u003e\n \u003cth\u003e\u003c/th\u003e\n \u003cth\u003ebare_nuclei\u003c/th\u003e\n \u003cth\u003eclass\u003c/th\u003e\n \u003cth\u003edoctor_name\u003c/th\u003e\n \u003c/tr\u003e\n \u003c/thead\u003e\n \u003ctbody\u003e\n \u003ctr\u003e\n \u003cth\u003ecount\u003c/th\u003e\n \u003ctd\u003e697\u003c/td\u003e\n \u003ctd\u003e699\u003c/td\u003e\n \u003ctd\u003e699\u003c/td\u003e\n \u003c/tr\u003e\n \u003ctr\u003e\n \u003cth\u003eunique\u003c/th\u003e\n \u003ctd\u003e11\u003c/td\u003e\n \u003ctd\u003e2\u003c/td\u003e\n \u003ctd\u003e4\u003c/td\u003e\n \u003c/tr\u003e\n \u003ctr\u003e\n \u003cth\u003etop\u003c/th\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003ebenign\u003c/td\u003e\n \u003ctd\u003eDr. Doe\u003c/td\u003e\n \u003c/tr\u003e\n \u003ctr\u003e\n \u003cth\u003efreq\u003c/th\u003e\n \u003ctd\u003e401\u003c/td\u003e\n \u003ctd\u003e458\u003c/td\u003e\n \u003ctd\u003e185\u003c/td\u003e\n \u003c/tr\u003e\n \u003c/tbody\u003e\n\u003c/table\u003e\n\u003c/div\u003e\n\n---\n\n# 3. Data Reshaping\n\nTime to remix our data and give it a fresh new vibe! With the code snippet you've got in hand, we're about to shake things up and reshape our dataset like never before. By grooving to the beat of `df.groupby(by=['doctor_name', 'class']).count()`, we're taking our data on a whole new journey.\n\nPicture this: we're gathering our data around the DJ booth, grouping it by the soothing sounds of `doctor_name` and the electrifying beats of `class`. Then, we crank up the volume with the aggregation function, counting up the hits in each group. It's like taking our dataset to a cool underground club, where every combination of doctor and class brings its own unique vibe.\n\nWhy does this matter? Well, reshaping our data in this way allows us to uncover fresh insights and patterns that might have been hidden before. It's like remixing a classic track—same ingredients, but with a whole new flavor. So, grab your data and let's hit the dance floor, because we're about to reshape it into something truly groovy! 🎧💃\n\n```python\n# This aggreates the data by its column names, then we pass the aggregation function (size = count)\ndf.groupby(by =['doctor_name', 'class']).count()\n```\n\n\u003cdiv\u003e\n\u003cstyle scoped\u003e\n .dataframe tbody tr th:only-of-type {\n vertical-align: middle;\n }\n .dataframe tbody tr th {\n vertical-align: top;\n }\n .dataframe thead th {\n text-align: right;\n }\n\u003c/style\u003e\n\u003ctable border=\"1\" class=\"dataframe\"\u003e\n \u003cthead\u003e\n \u003ctr style=\"text-align: right;\"\u003e\n \u003cth\u003e\u003c/th\u003e\n \u003cth\u003e\u003c/th\u003e\n \u003cth\u003epatient_id\u003c/th\u003e\n \u003cth\u003eclump_thickness\u003c/th\u003e\n \u003cth\u003ecell_size_uniformity\u003c/th\u003e\n \u003cth\u003ecell_shape_uniformity\u003c/th\u003e\n \u003cth\u003emarginal_adhesion\u003c/th\u003e\n \u003cth\u003esingle_ep_cell_size\u003c/th\u003e\n \u003cth\u003ebare_nuclei\u003c/th\u003e\n \u003cth\u003ebland_chromatin\u003c/th\u003e\n \u003cth\u003enormal_nucleoli\u003c/th\u003e\n \u003cth\u003emitoses\u003c/th\u003e\n \u003c/tr\u003e\n \u003ctr\u003e\n \u003cth\u003edoctor_name\u003c/th\u003e\n \u003cth\u003eclass\u003c/th\u003e\n \u003cth\u003e\u003c/th\u003e\n \u003cth\u003e\u003c/th\u003e\n \u003cth\u003e\u003c/th\u003e\n \u003cth\u003e\u003c/th\u003e\n \u003cth\u003e\u003c/th\u003e\n \u003cth\u003e\u003c/th\u003e\n \u003cth\u003e\u003c/th\u003e\n \u003cth\u003e\u003c/th\u003e\n \u003cth\u003e\u003c/th\u003e\n \u003cth\u003e\u003c/th\u003e\n \u003c/tr\u003e\n \u003c/thead\u003e\n \u003ctbody\u003e\n \u003ctr\u003e\n \u003cth rowspan=\"2\" valign=\"top\"\u003eDr. Doe\u003c/th\u003e\n \u003cth\u003ebenign\u003c/th\u003e\n \u003ctd\u003e127\u003c/td\u003e\n \u003ctd\u003e127\u003c/td\u003e\n \u003ctd\u003e126\u003c/td\u003e\n \u003ctd\u003e127\u003c/td\u003e\n \u003ctd\u003e127\u003c/td\u003e\n \u003ctd\u003e127\u003c/td\u003e\n \u003ctd\u003e126\u003c/td\u003e\n \u003ctd\u003e126\u003c/td\u003e\n \u003ctd\u003e127\u003c/td\u003e\n \u003ctd\u003e127\u003c/td\u003e\n \u003c/tr\u003e\n \u003ctr\u003e\n \u003cth\u003emalignant\u003c/th\u003e\n \u003ctd\u003e58\u003c/td\u003e\n \u003ctd\u003e58\u003c/td\u003e\n \u003ctd\u003e58\u003c/td\u003e\n \u003ctd\u003e58\u003c/td\u003e\n \u003ctd\u003e58\u003c/td\u003e\n \u003ctd\u003e58\u003c/td\u003e\n \u003ctd\u003e58\u003c/td\u003e\n \u003ctd\u003e57\u003c/td\u003e\n \u003ctd\u003e58\u003c/td\u003e\n \u003ctd\u003e58\u003c/td\u003e\n \u003c/tr\u003e\n \u003ctr\u003e\n \u003cth rowspan=\"2\" valign=\"top\"\u003eDr. Lee\u003c/th\u003e\n \u003cth\u003ebenign\u003c/th\u003e\n \u003ctd\u003e121\u003c/td\u003e\n \u003ctd\u003e121\u003c/td\u003e\n \u003ctd\u003e121\u003c/td\u003e\n \u003ctd\u003e121\u003c/td\u003e\n \u003ctd\u003e121\u003c/td\u003e\n \u003ctd\u003e121\u003c/td\u003e\n \u003ctd\u003e121\u003c/td\u003e\n \u003ctd\u003e119\u003c/td\u003e\n \u003ctd\u003e121\u003c/td\u003e\n \u003ctd\u003e121\u003c/td\u003e\n \u003c/tr\u003e\n \u003ctr\u003e\n \u003cth\u003emalignant\u003c/th\u003e\n \u003ctd\u003e60\u003c/td\u003e\n \u003ctd\u003e60\u003c/td\u003e\n \u003ctd\u003e60\u003c/td\u003e\n \u003ctd\u003e60\u003c/td\u003e\n \u003ctd\u003e60\u003c/td\u003e\n \u003ctd\u003e60\u003c/td\u003e\n \u003ctd\u003e60\u003c/td\u003e\n \u003ctd\u003e60\u003c/td\u003e\n \u003ctd\u003e60\u003c/td\u003e\n \u003ctd\u003e60\u003c/td\u003e\n \u003c/tr\u003e\n \u003ctr\u003e\n \u003cth rowspan=\"2\" valign=\"top\"\u003eDr. Smith\u003c/th\u003e\n \u003cth\u003ebenign\u003c/th\u003e\n \u003ctd\u003e102\u003c/td\u003e\n \u003ctd\u003e102\u003c/td\u003e\n \u003ctd\u003e102\u003c/td\u003e\n \u003ctd\u003e102\u003c/td\u003e\n \u003ctd\u003e102\u003c/td\u003e\n \u003ctd\u003e102\u003c/td\u003e\n \u003ctd\u003e102\u003c/td\u003e\n \u003ctd\u003e102\u003c/td\u003e\n \u003ctd\u003e102\u003c/td\u003e\n \u003ctd\u003e102\u003c/td\u003e\n \u003c/tr\u003e\n \u003ctr\u003e\n \u003cth\u003emalignant\u003c/th\u003e\n \u003ctd\u003e74\u003c/td\u003e\n \u003ctd\u003e73\u003c/td\u003e\n \u003ctd\u003e74\u003c/td\u003e\n \u003ctd\u003e74\u003c/td\u003e\n \u003ctd\u003e74\u003c/td\u003e\n \u003ctd\u003e74\u003c/td\u003e\n \u003ctd\u003e73\u003c/td\u003e\n \u003ctd\u003e74\u003c/td\u003e\n \u003ctd\u003e74\u003c/td\u003e\n \u003ctd\u003e74\u003c/td\u003e\n \u003c/tr\u003e\n \u003ctr\u003e\n \u003cth rowspan=\"2\" valign=\"top\"\u003eDr. Wong\u003c/th\u003e\n \u003cth\u003ebenign\u003c/th\u003e\n \u003ctd\u003e108\u003c/td\u003e\n \u003ctd\u003e108\u003c/td\u003e\n \u003ctd\u003e108\u003c/td\u003e\n \u003ctd\u003e108\u003c/td\u003e\n \u003ctd\u003e108\u003c/td\u003e\n \u003ctd\u003e108\u003c/td\u003e\n \u003ctd\u003e108\u003c/td\u003e\n \u003ctd\u003e108\u003c/td\u003e\n \u003ctd\u003e107\u003c/td\u003e\n \u003ctd\u003e108\u003c/td\u003e\n \u003c/tr\u003e\n \u003ctr\u003e\n \u003cth\u003emalignant\u003c/th\u003e\n \u003ctd\u003e49\u003c/td\u003e\n \u003ctd\u003e49\u003c/td\u003e\n \u003ctd\u003e49\u003c/td\u003e\n \u003ctd\u003e49\u003c/td\u003e\n \u003ctd\u003e49\u003c/td\u003e\n \u003ctd\u003e49\u003c/td\u003e\n \u003ctd\u003e49\u003c/td\u003e\n \u003ctd\u003e49\u003c/td\u003e\n \u003ctd\u003e49\u003c/td\u003e\n \u003ctd\u003e49\u003c/td\u003e\n \u003c/tr\u003e\n \u003c/tbody\u003e\n\u003c/table\u003e\n\u003c/div\u003e\n\n```python\ndf.groupby(by =['class', 'doctor_name']).count()\n```\n\n\u003cdiv\u003e\n\u003cstyle scoped\u003e\n .dataframe tbody tr th:only-of-type {\n vertical-align: middle;\n }\n .dataframe tbody tr th {\n vertical-align: top;\n }\n .dataframe thead th {\n text-align: right;\n }\n\u003c/style\u003e\n\u003ctable border=\"1\" class=\"dataframe\"\u003e\n \u003cthead\u003e\n \u003ctr style=\"text-align: right;\"\u003e\n \u003cth\u003e\u003c/th\u003e\n \u003cth\u003e\u003c/th\u003e\n \u003cth\u003epatient_id\u003c/th\u003e\n \u003cth\u003eclump_thickness\u003c/th\u003e\n \u003cth\u003ecell_size_uniformity\u003c/th\u003e\n \u003cth\u003ecell_shape_uniformity\u003c/th\u003e\n \u003cth\u003emarginal_adhesion\u003c/th\u003e\n \u003cth\u003esingle_ep_cell_size\u003c/th\u003e\n \u003cth\u003ebare_nuclei\u003c/th\u003e\n \u003cth\u003ebland_chromatin\u003c/th\u003e\n \u003cth\u003enormal_nucleoli\u003c/th\u003e\n \u003cth\u003emitoses\u003c/th\u003e\n \u003c/tr\u003e\n \u003ctr\u003e\n \u003cth\u003eclass\u003c/th\u003e\n \u003cth\u003edoctor_name\u003c/th\u003e\n \u003cth\u003e\u003c/th\u003e\n \u003cth\u003e\u003c/th\u003e\n \u003cth\u003e\u003c/th\u003e\n \u003cth\u003e\u003c/th\u003e\n \u003cth\u003e\u003c/th\u003e\n \u003cth\u003e\u003c/th\u003e\n \u003cth\u003e\u003c/th\u003e\n \u003cth\u003e\u003c/th\u003e\n \u003cth\u003e\u003c/th\u003e\n \u003cth\u003e\u003c/th\u003e\n \u003c/tr\u003e\n \u003c/thead\u003e\n \u003ctbody\u003e\n \u003ctr\u003e\n \u003cth rowspan=\"4\" valign=\"top\"\u003ebenign\u003c/th\u003e\n \u003cth\u003eDr. Doe\u003c/th\u003e\n \u003ctd\u003e127\u003c/td\u003e\n \u003ctd\u003e127\u003c/td\u003e\n \u003ctd\u003e126\u003c/td\u003e\n \u003ctd\u003e127\u003c/td\u003e\n \u003ctd\u003e127\u003c/td\u003e\n \u003ctd\u003e127\u003c/td\u003e\n \u003ctd\u003e126\u003c/td\u003e\n \u003ctd\u003e126\u003c/td\u003e\n \u003ctd\u003e127\u003c/td\u003e\n \u003ctd\u003e127\u003c/td\u003e\n \u003c/tr\u003e\n \u003ctr\u003e\n \u003cth\u003eDr. Lee\u003c/th\u003e\n \u003ctd\u003e121\u003c/td\u003e\n \u003ctd\u003e121\u003c/td\u003e\n \u003ctd\u003e121\u003c/td\u003e\n \u003ctd\u003e121\u003c/td\u003e\n \u003ctd\u003e121\u003c/td\u003e\n \u003ctd\u003e121\u003c/td\u003e\n \u003ctd\u003e121\u003c/td\u003e\n \u003ctd\u003e119\u003c/td\u003e\n \u003ctd\u003e121\u003c/td\u003e\n \u003ctd\u003e121\u003c/td\u003e\n \u003c/tr\u003e\n \u003ctr\u003e\n \u003cth\u003eDr. Smith\u003c/th\u003e\n \u003ctd\u003e102\u003c/td\u003e\n \u003ctd\u003e102\u003c/td\u003e\n \u003ctd\u003e102\u003c/td\u003e\n \u003ctd\u003e102\u003c/td\u003e\n \u003ctd\u003e102\u003c/td\u003e\n \u003ctd\u003e102\u003c/td\u003e\n \u003ctd\u003e102\u003c/td\u003e\n \u003ctd\u003e102\u003c/td\u003e\n \u003ctd\u003e102\u003c/td\u003e\n \u003ctd\u003e102\u003c/td\u003e\n \u003c/tr\u003e\n \u003ctr\u003e\n \u003cth\u003eDr. Wong\u003c/th\u003e\n \u003ctd\u003e108\u003c/td\u003e\n \u003ctd\u003e108\u003c/td\u003e\n \u003ctd\u003e108\u003c/td\u003e\n \u003ctd\u003e108\u003c/td\u003e\n \u003ctd\u003e108\u003c/td\u003e\n \u003ctd\u003e108\u003c/td\u003e\n \u003ctd\u003e108\u003c/td\u003e\n \u003ctd\u003e108\u003c/td\u003e\n \u003ctd\u003e107\u003c/td\u003e\n \u003ctd\u003e108\u003c/td\u003e\n \u003c/tr\u003e\n \u003ctr\u003e\n \u003cth rowspan=\"4\" valign=\"top\"\u003emalignant\u003c/th\u003e\n \u003cth\u003eDr. Doe\u003c/th\u003e\n \u003ctd\u003e58\u003c/td\u003e\n \u003ctd\u003e58\u003c/td\u003e\n \u003ctd\u003e58\u003c/td\u003e\n \u003ctd\u003e58\u003c/td\u003e\n \u003ctd\u003e58\u003c/td\u003e\n \u003ctd\u003e58\u003c/td\u003e\n \u003ctd\u003e58\u003c/td\u003e\n \u003ctd\u003e57\u003c/td\u003e\n \u003ctd\u003e58\u003c/td\u003e\n \u003ctd\u003e58\u003c/td\u003e\n \u003c/tr\u003e\n \u003ctr\u003e\n \u003cth\u003eDr. Lee\u003c/th\u003e\n \u003ctd\u003e60\u003c/td\u003e\n \u003ctd\u003e60\u003c/td\u003e\n \u003ctd\u003e60\u003c/td\u003e\n \u003ctd\u003e60\u003c/td\u003e\n \u003ctd\u003e60\u003c/td\u003e\n \u003ctd\u003e60\u003c/td\u003e\n \u003ctd\u003e60\u003c/td\u003e\n \u003ctd\u003e60\u003c/td\u003e\n \u003ctd\u003e60\u003c/td\u003e\n \u003ctd\u003e60\u003c/td\u003e\n \u003c/tr\u003e\n \u003ctr\u003e\n \u003cth\u003eDr. Smith\u003c/th\u003e\n \u003ctd\u003e74\u003c/td\u003e\n \u003ctd\u003e73\u003c/td\u003e\n \u003ctd\u003e74\u003c/td\u003e\n \u003ctd\u003e74\u003c/td\u003e\n \u003ctd\u003e74\u003c/td\u003e\n \u003ctd\u003e74\u003c/td\u003e\n \u003ctd\u003e73\u003c/td\u003e\n \u003ctd\u003e74\u003c/td\u003e\n \u003ctd\u003e74\u003c/td\u003e\n \u003ctd\u003e74\u003c/td\u003e\n \u003c/tr\u003e\n \u003ctr\u003e\n \u003cth\u003eDr. Wong\u003c/th\u003e\n \u003ctd\u003e49\u003c/td\u003e\n \u003ctd\u003e49\u003c/td\u003e\n \u003ctd\u003e49\u003c/td\u003e\n \u003ctd\u003e49\u003c/td\u003e\n \u003ctd\u003e49\u003c/td\u003e\n \u003ctd\u003e49\u003c/td\u003e\n \u003ctd\u003e49\u003c/td\u003e\n \u003ctd\u003e49\u003c/td\u003e\n \u003ctd\u003e49\u003c/td\u003e\n \u003ctd\u003e49\u003c/td\u003e\n \u003c/tr\u003e\n \u003c/tbody\u003e\n\u003c/table\u003e\n\u003c/div\u003e\n\n```python\ndf.groupby(by =['bare_nuclei', 'class']).count()\n```\n\n\u003cdiv\u003e\n\u003cstyle scoped\u003e\n .dataframe tbody tr th:only-of-type {\n vertical-align: middle;\n }\n .dataframe tbody tr th {\n vertical-align: top;\n }\n .dataframe thead th {\n text-align: right;\n }\n\u003c/style\u003e\n\u003ctable border=\"1\" class=\"dataframe\"\u003e\n \u003cthead\u003e\n \u003ctr style=\"text-align: right;\"\u003e\n \u003cth\u003e\u003c/th\u003e\n \u003cth\u003e\u003c/th\u003e\n \u003cth\u003epatient_id\u003c/th\u003e\n \u003cth\u003eclump_thickness\u003c/th\u003e\n \u003cth\u003ecell_size_uniformity\u003c/th\u003e\n \u003cth\u003ecell_shape_uniformity\u003c/th\u003e\n \u003cth\u003emarginal_adhesion\u003c/th\u003e\n \u003cth\u003esingle_ep_cell_size\u003c/th\u003e\n \u003cth\u003ebland_chromatin\u003c/th\u003e\n \u003cth\u003enormal_nucleoli\u003c/th\u003e\n \u003cth\u003emitoses\u003c/th\u003e\n \u003cth\u003edoctor_name\u003c/th\u003e\n \u003c/tr\u003e\n \u003ctr\u003e\n \u003cth\u003ebare_nuclei\u003c/th\u003e\n \u003cth\u003eclass\u003c/th\u003e\n \u003cth\u003e\u003c/th\u003e\n \u003cth\u003e\u003c/th\u003e\n \u003cth\u003e\u003c/th\u003e\n \u003cth\u003e\u003c/th\u003e\n \u003cth\u003e\u003c/th\u003e\n \u003cth\u003e\u003c/th\u003e\n \u003cth\u003e\u003c/th\u003e\n \u003cth\u003e\u003c/th\u003e\n \u003cth\u003e\u003c/th\u003e\n \u003cth\u003e\u003c/th\u003e\n \u003c/tr\u003e\n \u003c/thead\u003e\n \u003ctbody\u003e\n \u003ctr\u003e\n \u003cth rowspan=\"2\" valign=\"top\"\u003e1\u003c/th\u003e\n \u003cth\u003ebenign\u003c/th\u003e\n \u003ctd\u003e386\u003c/td\u003e\n \u003ctd\u003e386\u003c/td\u003e\n \u003ctd\u003e386\u003c/td\u003e\n \u003ctd\u003e386\u003c/td\u003e\n \u003ctd\u003e386\u003c/td\u003e\n \u003ctd\u003e386\u003c/td\u003e\n \u003ctd\u003e383\u003c/td\u003e\n \u003ctd\u003e385\u003c/td\u003e\n \u003ctd\u003e386\u003c/td\u003e\n \u003ctd\u003e386\u003c/td\u003e\n \u003c/tr\u003e\n \u003ctr\u003e\n \u003cth\u003emalignant\u003c/th\u003e\n \u003ctd\u003e15\u003c/td\u003e\n \u003ctd\u003e15\u003c/td\u003e\n \u003ctd\u003e15\u003c/td\u003e\n \u003ctd\u003e15\u003c/td\u003e\n \u003ctd\u003e15\u003c/td\u003e\n \u003ctd\u003e15\u003c/td\u003e\n \u003ctd\u003e15\u003c/td\u003e\n \u003ctd\u003e15\u003c/td\u003e\n \u003ctd\u003e15\u003c/td\u003e\n \u003ctd\u003e15\u003c/td\u003e\n \u003c/tr\u003e\n \u003ctr\u003e\n \u003cth rowspan=\"2\" valign=\"top\"\u003e10\u003c/th\u003e\n \u003cth\u003ebenign\u003c/th\u003e\n \u003ctd\u003e3\u003c/td\u003e\n \u003ctd\u003e3\u003c/td\u003e\n \u003ctd\u003e2\u003c/td\u003e\n \u003ctd\u003e3\u003c/td\u003e\n \u003ctd\u003e3\u003c/td\u003e\n \u003ctd\u003e3\u003c/td\u003e\n \u003ctd\u003e3\u003c/td\u003e\n \u003ctd\u003e3\u003c/td\u003e\n \u003ctd\u003e3\u003c/td\u003e\n \u003ctd\u003e3\u003c/td\u003e\n \u003c/tr\u003e\n \u003ctr\u003e\n \u003cth\u003emalignant\u003c/th\u003e\n \u003ctd\u003e128\u003c/td\u003e\n \u003ctd\u003e128\u003c/td\u003e\n \u003ctd\u003e128\u003c/td\u003e\n \u003ctd\u003e128\u003c/td\u003e\n \u003ctd\u003e128\u003c/td\u003e\n \u003ctd\u003e128\u003c/td\u003e\n \u003ctd\u003e128\u003c/td\u003e\n \u003ctd\u003e128\u003c/td\u003e\n \u003ctd\u003e128\u003c/td\u003e\n \u003ctd\u003e128\u003c/td\u003e\n \u003c/tr\u003e\n \u003ctr\u003e\n \u003cth rowspan=\"2\" valign=\"top\"\u003e2\u003c/th\u003e\n \u003cth\u003ebenign\u003c/th\u003e\n \u003ctd\u003e21\u003c/td\u003e\n \u003ctd\u003e21\u003c/td\u003e\n \u003ctd\u003e21\u003c/td\u003e\n \u003ctd\u003e21\u003c/td\u003e\n \u003ctd\u003e21\u003c/td\u003e\n \u003ctd\u003e21\u003c/td\u003e\n \u003ctd\u003e21\u003c/td\u003e\n \u003ctd\u003e21\u003c/td\u003e\n \u003ctd\u003e21\u003c/td\u003e\n \u003ctd\u003e21\u003c/td\u003e\n \u003c/tr\u003e\n \u003ctr\u003e\n \u003cth\u003emalignant\u003c/th\u003e\n \u003ctd\u003e9\u003c/td\u003e\n \u003ctd\u003e9\u003c/td\u003e\n \u003ctd\u003e9\u003c/td\u003e\n \u003ctd\u003e9\u003c/td\u003e\n \u003ctd\u003e9\u003c/td\u003e\n \u003ctd\u003e9\u003c/td\u003e\n \u003ctd\u003e9\u003c/td\u003e\n \u003ctd\u003e9\u003c/td\u003e\n \u003ctd\u003e9\u003c/td\u003e\n \u003ctd\u003e9\u003c/td\u003e\n \u003c/tr\u003e\n \u003ctr\u003e\n \u003cth rowspan=\"2\" valign=\"top\"\u003e3\u003c/th\u003e\n \u003cth\u003ebenign\u003c/th\u003e\n \u003ctd\u003e14\u003c/td\u003e\n \u003ctd\u003e14\u003c/td\u003e\n \u003ctd\u003e14\u003c/td\u003e\n \u003ctd\u003e14\u003c/td\u003e\n \u003ctd\u003e14\u003c/td\u003e\n \u003ctd\u003e14\u003c/td\u003e\n \u003ctd\u003e14\u003c/td\u003e\n \u003ctd\u003e14\u003c/td\u003e\n \u003ctd\u003e14\u003c/td\u003e\n \u003ctd\u003e14\u003c/td\u003e\n \u003c/tr\u003e\n \u003ctr\u003e\n \u003cth\u003emalignant\u003c/th\u003e\n \u003ctd\u003e14\u003c/td\u003e\n \u003ctd\u003e13\u003c/td\u003e\n \u003ctd\u003e14\u003c/td\u003e\n \u003ctd\u003e14\u003c/td\u003e\n \u003ctd\u003e14\u003c/td\u003e\n \u003ctd\u003e14\u003c/td\u003e\n \u003ctd\u003e14\u003c/td\u003e\n \u003ctd\u003e14\u003c/td\u003e\n \u003ctd\u003e14\u003c/td\u003e\n \u003ctd\u003e14\u003c/td\u003e\n \u003c/tr\u003e\n \u003ctr\u003e\n \u003cth rowspan=\"2\" valign=\"top\"\u003e4\u003c/th\u003e\n \u003cth\u003ebenign\u003c/th\u003e\n \u003ctd\u003e6\u003c/td\u003e\n \u003ctd\u003e6\u003c/td\u003e\n \u003ctd\u003e6\u003c/td\u003e\n \u003ctd\u003e6\u003c/td\u003e\n \u003ctd\u003e6\u003c/td\u003e\n \u003ctd\u003e6\u003c/td\u003e\n \u003ctd\u003e6\u003c/td\u003e\n \u003ctd\u003e6\u003c/td\u003e\n \u003ctd\u003e6\u003c/td\u003e\n \u003ctd\u003e6\u003c/td\u003e\n \u003c/tr\u003e\n \u003ctr\u003e\n \u003cth\u003emalignant\u003c/th\u003e\n \u003ctd\u003e13\u003c/td\u003e\n \u003ctd\u003e13\u003c/td\u003e\n \u003ctd\u003e13\u003c/td\u003e\n \u003ctd\u003e13\u003c/td\u003e\n \u003ctd\u003e13\u003c/td\u003e\n \u003ctd\u003e13\u003c/td\u003e\n \u003ctd\u003e13\u003c/td\u003e\n \u003ctd\u003e13\u003c/td\u003e\n \u003ctd\u003e13\u003c/td\u003e\n \u003ctd\u003e13\u003c/td\u003e\n \u003c/tr\u003e\n \u003ctr\u003e\n \u003cth rowspan=\"2\" valign=\"top\"\u003e5\u003c/th\u003e\n \u003cth\u003ebenign\u003c/th\u003e\n \u003ctd\u003e10\u003c/td\u003e\n \u003ctd\u003e10\u003c/td\u003e\n \u003ctd\u003e10\u003c/td\u003e\n \u003ctd\u003e10\u003c/td\u003e\n \u003ctd\u003e10\u003c/td\u003e\n \u003ctd\u003e10\u003c/td\u003e\n \u003ctd\u003e10\u003c/td\u003e\n \u003ctd\u003e10\u003c/td\u003e\n \u003ctd\u003e10\u003c/td\u003e\n \u003ctd\u003e10\u003c/td\u003e\n \u003c/tr\u003e\n \u003ctr\u003e\n \u003cth\u003emalignant\u003c/th\u003e\n \u003ctd\u003e20\u003c/td\u003e\n \u003ctd\u003e20\u003c/td\u003e\n \u003ctd\u003e20\u003c/td\u003e\n \u003ctd\u003e20\u003c/td\u003e\n \u003ctd\u003e20\u003c/td\u003e\n \u003ctd\u003e20\u003c/td\u003e\n \u003ctd\u003e20\u003c/td\u003e\n \u003ctd\u003e20\u003c/td\u003e\n \u003ctd\u003e20\u003c/td\u003e\n \u003ctd\u003e20\u003c/td\u003e\n \u003c/tr\u003e\n \u003ctr\u003e\n \u003cth\u003e6\u003c/th\u003e\n \u003cth\u003emalignant\u003c/th\u003e\n \u003ctd\u003e4\u003c/td\u003e\n \u003ctd\u003e4\u003c/td\u003e\n \u003ctd\u003e4\u003c/td\u003e\n \u003ctd\u003e4\u003c/td\u003e\n \u003ctd\u003e4\u003c/td\u003e\n \u003ctd\u003e4\u003c/td\u003e\n \u003ctd\u003e4\u003c/td\u003e\n \u003ctd\u003e4\u003c/td\u003e\n \u003ctd\u003e4\u003c/td\u003e\n \u003ctd\u003e4\u003c/td\u003e\n \u003c/tr\u003e\n \u003ctr\u003e\n \u003cth rowspan=\"2\" valign=\"top\"\u003e7\u003c/th\u003e\n \u003cth\u003ebenign\u003c/th\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003c/tr\u003e\n \u003ctr\u003e\n \u003cth\u003emalignant\u003c/th\u003e\n \u003ctd\u003e7\u003c/td\u003e\n \u003ctd\u003e7\u003c/td\u003e\n \u003ctd\u003e7\u003c/td\u003e\n \u003ctd\u003e7\u003c/td\u003e\n \u003ctd\u003e7\u003c/td\u003e\n \u003ctd\u003e7\u003c/td\u003e\n \u003ctd\u003e6\u003c/td\u003e\n \u003ctd\u003e7\u003c/td\u003e\n \u003ctd\u003e7\u003c/td\u003e\n \u003ctd\u003e7\u003c/td\u003e\n \u003c/tr\u003e\n \u003ctr\u003e\n \u003cth rowspan=\"2\" valign=\"top\"\u003e8\u003c/th\u003e\n \u003cth\u003ebenign\u003c/th\u003e\n \u003ctd\u003e2\u003c/td\u003e\n \u003ctd\u003e2\u003c/td\u003e\n \u003ctd\u003e2\u003c/td\u003e\n \u003ctd\u003e2\u003c/td\u003e\n \u003ctd\u003e2\u003c/td\u003e\n \u003ctd\u003e2\u003c/td\u003e\n \u003ctd\u003e2\u003c/td\u003e\n \u003ctd\u003e2\u003c/td\u003e\n \u003ctd\u003e2\u003c/td\u003e\n \u003ctd\u003e2\u003c/td\u003e\n \u003c/tr\u003e\n \u003ctr\u003e\n \u003cth\u003emalignant\u003c/th\u003e\n \u003ctd\u003e19\u003c/td\u003e\n \u003ctd\u003e19\u003c/td\u003e\n \u003ctd\u003e19\u003c/td\u003e\n \u003ctd\u003e19\u003c/td\u003e\n \u003ctd\u003e19\u003c/td\u003e\n \u003ctd\u003e19\u003c/td\u003e\n \u003ctd\u003e19\u003c/td\u003e\n \u003ctd\u003e19\u003c/td\u003e\n \u003ctd\u003e19\u003c/td\u003e\n \u003ctd\u003e19\u003c/td\u003e\n \u003c/tr\u003e\n \u003ctr\u003e\n \u003cth\u003e9\u003c/th\u003e\n \u003cth\u003emalignant\u003c/th\u003e\n \u003ctd\u003e9\u003c/td\u003e\n \u003ctd\u003e9\u003c/td\u003e\n \u003ctd\u003e9\u003c/td\u003e\n \u003ctd\u003e9\u003c/td\u003e\n \u003ctd\u003e9\u003c/td\u003e\n \u003ctd\u003e9\u003c/td\u003e\n \u003ctd\u003e9\u003c/td\u003e\n \u003ctd\u003e9\u003c/td\u003e\n \u003ctd\u003e9\u003c/td\u003e\n \u003ctd\u003e9\u003c/td\u003e\n \u003c/tr\u003e\n \u003ctr\u003e\n \u003cth rowspan=\"2\" valign=\"top\"\u003e?\u003c/th\u003e\n \u003cth\u003ebenign\u003c/th\u003e\n \u003ctd\u003e14\u003c/td\u003e\n \u003ctd\u003e14\u003c/td\u003e\n \u003ctd\u003e14\u003c/td\u003e\n \u003ctd\u003e14\u003c/td\u003e\n \u003ctd\u003e14\u003c/td\u003e\n \u003ctd\u003e14\u003c/td\u003e\n \u003ctd\u003e14\u003c/td\u003e\n \u003ctd\u003e14\u003c/td\u003e\n \u003ctd\u003e14\u003c/td\u003e\n \u003ctd\u003e14\u003c/td\u003e\n \u003c/tr\u003e\n \u003ctr\u003e\n \u003cth\u003emalignant\u003c/th\u003e\n \u003ctd\u003e2\u003c/td\u003e\n \u003ctd\u003e2\u003c/td\u003e\n \u003ctd\u003e2\u003c/td\u003e\n \u003ctd\u003e2\u003c/td\u003e\n \u003ctd\u003e2\u003c/td\u003e\n \u003ctd\u003e2\u003c/td\u003e\n \u003ctd\u003e2\u003c/td\u003e\n \u003ctd\u003e2\u003c/td\u003e\n \u003ctd\u003e2\u003c/td\u003e\n \u003ctd\u003e2\u003c/td\u003e\n \u003c/tr\u003e\n \u003c/tbody\u003e\n\u003c/table\u003e\n\u003c/div\u003e\n\n\u003chr \u003e\n\n# 4. Data Cleaning\n\nAlright, time to chill and tidy up our dataset! Now that we've wrapped up the early analysis phase, it's onto the next groove: cleaning up our data. Picture this: your data rolls in with all sorts of shapes and sizes, like records in a crate waiting to be sorted. But the real magic happens when we polish it up, turning it into the complete and comprehensive masterpiece we need.\n\nSure, it's like sifting through a crate of vinyl, each record with its own scratches and dust. But trust me, the best jams come from the cleanest cuts. By whipping our dataset into shape, we're setting the stage for some serious feature engineering and analysis down the line. So, grab your data mop and broom, because we're about to sweep away the dust and uncover the smooth grooves beneath. Let's get cleaning! 🎶✨\n\n## 4.1 Missing Records\n\nAmong one of the easiet way to identify whether or not your dataset has any missing data in them, would be to check them using the `.isna()` method and combine them with the `.sum()` function. It would in return, give you information on how many rows gone missing in your current dataset. Usually Pandas, would assing them with the value of `NaN`, but it can always be just a blank value in the record cell.\n\n```python\ndf.isna().sum()\n```\n\n patient_id 0\n clump_thickness 1\n cell_size_uniformity 1\n cell_shape_uniformity 0\n marginal_adhesion 0\n single_ep_cell_size 0\n bare_nuclei 2\n bland_chromatin 4\n normal_nucleoli 1\n mitoses 0\n class 0\n doctor_name 0\n dtype: int64\n\nGood to know that the `patient_id` has `0` missing values, but as you may notice, others columns much like `clump_thickness`, `cell_size_uniformity`, `bare_nuclei`, `bland_chromatin` and `normal_nucleoli`, and to put them in total, there are 9 missing rows in the dataset.\n\n## 4.2 How To Deal With?\n\nThe real question isn't just about spotting the missing records and summing them up. The real jazz starts when you decide how to handle them before moving forward on your data wrangling journey. In this particular case, we've got a small amount of data with missing values—just `9 rows` out of `699`. That's a mere `0.012`, or less than 1% of the total dataset. With such a small fraction, I'm thinking we drop them like they're hot, using the `.dropna` method. And while we're at it, let’s break down the cool attributes that groove along with the `.dropna` method.\n\n- `Axis`: Decides if you're dropping rows or columns. `0` means rows, while `1` goes for columns.\n- `How`: Two vibes here—_any_ or _all_. If you choose `all`, it drops rows or columns that are completely empty. Opt for `any`, and it drops those with even a single missing value.\n- `Inplace`: This one's crucial. If you set `inplace=True`, changes will happen right on the DataFrame you're working with. If it's `False` (which is the default), the original DataFrame stays untouched, and a new one is returned.\n\nSo, let's clean up those missing beats and keep the data flowing smoothly!\n\n```python\ndf.dropna(axis=0, how='any', inplace=True)\n```\n\n```python\ndf\n```\n\n\u003cdiv\u003e\n\u003cstyle scoped\u003e\n .dataframe tbody tr th:only-of-type {\n vertical-align: middle;\n }\n\n .dataframe tbody tr th {\n vertical-align: top;\n }\n\n .dataframe thead th {\n text-align: right;\n }\n\n\u003c/style\u003e\n\u003ctable border=\"1\" class=\"dataframe\"\u003e\n \u003cthead\u003e\n \u003ctr style=\"text-align: right;\"\u003e\n \u003cth\u003e\u003c/th\u003e\n \u003cth\u003epatient_id\u003c/th\u003e\n \u003cth\u003eclump_thickness\u003c/th\u003e\n \u003cth\u003ecell_size_uniformity\u003c/th\u003e\n \u003cth\u003ecell_shape_uniformity\u003c/th\u003e\n \u003cth\u003emarginal_adhesion\u003c/th\u003e\n \u003cth\u003esingle_ep_cell_size\u003c/th\u003e\n \u003cth\u003ebare_nuclei\u003c/th\u003e\n \u003cth\u003ebland_chromatin\u003c/th\u003e\n \u003cth\u003enormal_nucleoli\u003c/th\u003e\n \u003cth\u003emitoses\u003c/th\u003e\n \u003cth\u003eclass\u003c/th\u003e\n \u003cth\u003edoctor_name\u003c/th\u003e\n \u003c/tr\u003e\n \u003c/thead\u003e\n \u003ctbody\u003e\n \u003ctr\u003e\n \u003cth\u003e0\u003c/th\u003e\n \u003ctd\u003e1000025\u003c/td\u003e\n \u003ctd\u003e5.0\u003c/td\u003e\n \u003ctd\u003e1.0\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003e2\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003e3.0\u003c/td\u003e\n \u003ctd\u003e1.0\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003ebenign\u003c/td\u003e\n \u003ctd\u003eDr. Doe\u003c/td\u003e\n \u003c/tr\u003e\n \u003ctr\u003e\n \u003cth\u003e1\u003c/th\u003e\n \u003ctd\u003e1002945\u003c/td\u003e\n \u003ctd\u003e5.0\u003c/td\u003e\n \u003ctd\u003e4.0\u003c/td\u003e\n \u003ctd\u003e4\u003c/td\u003e\n \u003ctd\u003e5\u003c/td\u003e\n \u003ctd\u003e7\u003c/td\u003e\n \u003ctd\u003e10\u003c/td\u003e\n \u003ctd\u003e3.0\u003c/td\u003e\n \u003ctd\u003e2.0\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003ebenign\u003c/td\u003e\n \u003ctd\u003eDr. Smith\u003c/td\u003e\n \u003c/tr\u003e\n \u003ctr\u003e\n \u003cth\u003e2\u003c/th\u003e\n \u003ctd\u003e1015425\u003c/td\u003e\n \u003ctd\u003e3.0\u003c/td\u003e\n \u003ctd\u003e1.0\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003e2\u003c/td\u003e\n \u003ctd\u003e2\u003c/td\u003e\n \u003ctd\u003e3.0\u003c/td\u003e\n \u003ctd\u003e1.0\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003ebenign\u003c/td\u003e\n \u003ctd\u003eDr. Lee\u003c/td\u003e\n \u003c/tr\u003e\n \u003ctr\u003e\n \u003cth\u003e3\u003c/th\u003e\n \u003ctd\u003e1016277\u003c/td\u003e\n \u003ctd\u003e6.0\u003c/td\u003e\n \u003ctd\u003e8.0\u003c/td\u003e\n \u003ctd\u003e8\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003e3\u003c/td\u003e\n \u003ctd\u003e4\u003c/td\u003e\n \u003ctd\u003e3.0\u003c/td\u003e\n \u003ctd\u003e7.0\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003ebenign\u003c/td\u003e\n \u003ctd\u003eDr. Smith\u003c/td\u003e\n \u003c/tr\u003e\n \u003ctr\u003e\n \u003cth\u003e4\u003c/th\u003e\n \u003ctd\u003e1017023\u003c/td\u003e\n \u003ctd\u003e4.0\u003c/td\u003e\n \u003ctd\u003e1.0\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003e3\u003c/td\u003e\n \u003ctd\u003e2\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003e3.0\u003c/td\u003e\n \u003ctd\u003e1.0\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003ebenign\u003c/td\u003e\n \u003ctd\u003eDr. Wong\u003c/td\u003e\n \u003c/tr\u003e\n \u003ctr\u003e\n \u003cth\u003e...\u003c/th\u003e\n \u003ctd\u003e...\u003c/td\u003e\n \u003ctd\u003e...\u003c/td\u003e\n \u003ctd\u003e...\u003c/td\u003e\n \u003ctd\u003e...\u003c/td\u003e\n \u003ctd\u003e...\u003c/td\u003e\n \u003ctd\u003e...\u003c/td\u003e\n \u003ctd\u003e...\u003c/td\u003e\n \u003ctd\u003e...\u003c/td\u003e\n \u003ctd\u003e...\u003c/td\u003e\n \u003ctd\u003e...\u003c/td\u003e\n \u003ctd\u003e...\u003c/td\u003e\n \u003ctd\u003e...\u003c/td\u003e\n \u003c/tr\u003e\n \u003ctr\u003e\n \u003cth\u003e694\u003c/th\u003e\n \u003ctd\u003e776715\u003c/td\u003e\n \u003ctd\u003e3.0\u003c/td\u003e\n \u003ctd\u003e1.0\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003e3\u003c/td\u003e\n \u003ctd\u003e2\u003c/td\u003e\n \u003ctd\u003e1.0\u003c/td\u003e\n \u003ctd\u003e1.0\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003ebenign\u003c/td\u003e\n \u003ctd\u003eDr. Lee\u003c/td\u003e\n \u003c/tr\u003e\n \u003ctr\u003e\n \u003cth\u003e695\u003c/th\u003e\n \u003ctd\u003e841769\u003c/td\u003e\n \u003ctd\u003e2.0\u003c/td\u003e\n \u003ctd\u003e1.0\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003e2\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003e1.0\u003c/td\u003e\n \u003ctd\u003e1.0\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003ebenign\u003c/td\u003e\n \u003ctd\u003eDr. Smith\u003c/td\u003e\n \u003c/tr\u003e\n \u003ctr\u003e\n \u003cth\u003e696\u003c/th\u003e\n \u003ctd\u003e888820\u003c/td\u003e\n \u003ctd\u003e5.0\u003c/td\u003e\n \u003ctd\u003e10.0\u003c/td\u003e\n \u003ctd\u003e10\u003c/td\u003e\n \u003ctd\u003e3\u003c/td\u003e\n \u003ctd\u003e7\u003c/td\u003e\n \u003ctd\u003e3\u003c/td\u003e\n \u003ctd\u003e8.0\u003c/td\u003e\n \u003ctd\u003e10.0\u003c/td\u003e\n \u003ctd\u003e2\u003c/td\u003e\n \u003ctd\u003emalignant\u003c/td\u003e\n \u003ctd\u003eDr. Lee\u003c/td\u003e\n \u003c/tr\u003e\n \u003ctr\u003e\n \u003cth\u003e697\u003c/th\u003e\n \u003ctd\u003e897471\u003c/td\u003e\n \u003ctd\u003e4.0\u003c/td\u003e\n \u003ctd\u003e8.0\u003c/td\u003e\n \u003ctd\u003e6\u003c/td\u003e\n \u003ctd\u003e4\u003c/td\u003e\n \u003ctd\u003e3\u003c/td\u003e\n \u003ctd\u003e4\u003c/td\u003e\n \u003ctd\u003e10.0\u003c/td\u003e\n \u003ctd\u003e6.0\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003emalignant\u003c/td\u003e\n \u003ctd\u003eDr. Lee\u003c/td\u003e\n \u003c/tr\u003e\n \u003ctr\u003e\n \u003cth\u003e698\u003c/th\u003e\n \u003ctd\u003e897471\u003c/td\u003e\n \u003ctd\u003e4.0\u003c/td\u003e\n \u003ctd\u003e8.0\u003c/td\u003e\n \u003ctd\u003e8\u003c/td\u003e\n \u003ctd\u003e5\u003c/td\u003e\n \u003ctd\u003e4\u003c/td\u003e\n \u003ctd\u003e5\u003c/td\u003e\n \u003ctd\u003e10.0\u003c/td\u003e\n \u003ctd\u003e4.0\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003emalignant\u003c/td\u003e\n \u003ctd\u003eDr. Wong\u003c/td\u003e\n \u003c/tr\u003e\n \u003c/tbody\u003e\n\u003c/table\u003e\n\u003cp\u003e690 rows × 12 columns\u003c/p\u003e\n\u003c/div\u003e\n\nAs you can see now, the rows number have been decreased, from `699` to `690`, down with `9` records, but left us with clean dataset with no empty cells in them. Let move on to check them!\n\n```python\ndf.isnull().values.any()\n```\n\n False\n\n## 4.3 Rechecking\n\nNow that we've got our dataset shining bright with no empty records, we might still be wondering if there’s another way to double-check for any sneaky missing values. Good news, data groovers! There's a slick method called `.isnull` that performs a boolean check, giving you a smooth true or false response to your inquiry. It's like having a jazz soloist confirming every note is in place. So, let's slide into it and make sure our dataset is as clean as a crisp vinyl record. Let’s do this! 🎷✨\n\n## 4.4 Validating\n\nSo, our dataset’s looking sharp, but let’s not stop there. If you're curious whether there are still any hidden empty cells lurking around, there's a cool cat method called `.isnull` that’s perfect for the job. This boolean checker will let us know with a simple true or false if any values are missing. It’s like having an extra pair of ears in the studio, ensuring every beat is perfect. Let’s give it a spin and make sure everything's in tip-top shape! 🎶🔍\n\n```python\ndf.isnull()\n```\n\n\u003cdiv\u003e\n\u003cstyle scoped\u003e\n .dataframe tbody tr th:only-of-type {\n vertical-align: middle;\n }\n .dataframe tbody tr th {\n vertical-align: top;\n }\n .dataframe thead th {\n text-align: right;\n }\n\u003c/style\u003e\n\u003ctable border=\"1\" class=\"dataframe\"\u003e\n \u003cthead\u003e\n \u003ctr style=\"text-align: right;\"\u003e\n \u003cth\u003e\u003c/th\u003e\n \u003cth\u003epatient_id\u003c/th\u003e\n \u003cth\u003eclump_thickness\u003c/th\u003e\n \u003cth\u003ecell_size_uniformity\u003c/th\u003e\n \u003cth\u003ecell_shape_uniformity\u003c/th\u003e\n \u003cth\u003emarginal_adhesion\u003c/th\u003e\n \u003cth\u003esingle_ep_cell_size\u003c/th\u003e\n \u003cth\u003ebare_nuclei\u003c/th\u003e\n \u003cth\u003ebland_chromatin\u003c/th\u003e\n \u003cth\u003enormal_nucleoli\u003c/th\u003e\n \u003cth\u003emitoses\u003c/th\u003e\n \u003cth\u003eclass\u003c/th\u003e\n \u003cth\u003edoctor_name\u003c/th\u003e\n \u003c/tr\u003e\n \u003c/thead\u003e\n \u003ctbody\u003e\n \u003ctr\u003e\n \u003cth\u003e0\u003c/th\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003c/tr\u003e\n \u003ctr\u003e\n \u003cth\u003e1\u003c/th\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003c/tr\u003e\n \u003ctr\u003e\n \u003cth\u003e2\u003c/th\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003c/tr\u003e\n \u003ctr\u003e\n \u003cth\u003e3\u003c/th\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003c/tr\u003e\n \u003ctr\u003e\n \u003cth\u003e4\u003c/th\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003c/tr\u003e\n \u003ctr\u003e\n \u003cth\u003e...\u003c/th\u003e\n \u003ctd\u003e...\u003c/td\u003e\n \u003ctd\u003e...\u003c/td\u003e\n \u003ctd\u003e...\u003c/td\u003e\n \u003ctd\u003e...\u003c/td\u003e\n \u003ctd\u003e...\u003c/td\u003e\n \u003ctd\u003e...\u003c/td\u003e\n \u003ctd\u003e...\u003c/td\u003e\n \u003ctd\u003e...\u003c/td\u003e\n \u003ctd\u003e...\u003c/td\u003e\n \u003ctd\u003e...\u003c/td\u003e\n \u003ctd\u003e...\u003c/td\u003e\n \u003ctd\u003e...\u003c/td\u003e\n \u003c/tr\u003e\n \u003ctr\u003e\n \u003cth\u003e694\u003c/th\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003c/tr\u003e\n \u003ctr\u003e\n \u003cth\u003e695\u003c/th\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003c/tr\u003e\n \u003ctr\u003e\n \u003cth\u003e696\u003c/th\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003c/tr\u003e\n \u003ctr\u003e\n \u003cth\u003e697\u003c/th\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003c/tr\u003e\n \u003ctr\u003e\n \u003cth\u003e698\u003c/th\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003c/tr\u003e\n \u003c/tbody\u003e\n\u003c/table\u003e\n\u003cp\u003e690 rows × 12 columns\u003c/p\u003e\n\u003c/div\u003e\n\nSo far, so groovy! From our dataset checks, everything's coming back with `False` values, and that's music to our ears. It means one thing: our dataset is spotless and ready to jam. With our data all tuned up, it's time to move on to the next leg of our journey. So, let's keep the rhythm going and dive into the next adventure. Onward to data greatness! 🎷✨\n\n## 4.5 Duplicate Records\n\nAlright, let's jazz things up and hunt for those duplicate records! First, we need to investigate whether our dataset is hiding any duplicate grooves in the cell records. By getting on top of this early, we can dodge potential hurdles that might throw our analysis offbeat and introduce unwanted bias.\n\nTo kick off this detective work, we’ll use the `.nunique` method. This little gem will give us some solid pointers to detect any anomalies lurking in our dataset. We’ll start by grooving through the columns that are supposed to have unique identifiers—those special `object` datatype columns. In our case, it’s the `patient_id` column. So, let’s spin that record and see if we have any duplicates in the mix! 🎷🔍\n\n```python\ndf.nunique()\n```\n\n patient_id 637\n clump_thickness 10\n cell_size_uniformity 10\n cell_shape_uniformity 10\n marginal_adhesion 10\n single_ep_cell_size 10\n bare_nuclei 11\n bland_chromatin 10\n normal_nucleoli 10\n mitoses 9\n class 2\n doctor_name 4\n dtype: int64\n\n```python\ndf.info()\n```\n\n \u003cclass 'pandas.core.frame.DataFrame'\u003e\n Index: 690 entries, 0 to 698\n Data columns (total 12 columns):\n # Column Non-Null Count Dtype\n --- ------ -------------- -----\n 0 patient_id 690 non-null int64\n 1 clump_thickness 690 non-null float64\n 2 cell_size_uniformity 690 non-null float64\n 3 cell_shape_uniformity 690 non-null int64\n 4 marginal_adhesion 690 non-null int64\n 5 single_ep_cell_size 690 non-null int64\n 6 bare_nuclei 690 non-null object\n 7 bland_chromatin 690 non-null float64\n 8 normal_nucleoli 690 non-null float64\n 9 mitoses 690 non-null int64\n 10 class 690 non-null object\n 11 doctor_name 690 non-null object\n dtypes: float64(4), int64(5), object(3)\n memory usage: 70.1+ KB\n\nWe know for sure that our dataset is jamming with `690` rows and `12` columns (down from the previous `699`). But hold on a second—when we dig into the groove, we find that `patient_id` only has `637` records. Something's offbeat here, especially since `patient_id` should be our unique identifier. We should be seeing a solid `690` records, not just `637`.\n\nTime to put on our detective hats and investigate this mystery. There’s gotta be some duplication in the `patient_id` column messing with our flow. Let’s dive deep, spin those records backwards, and uncover where the duplicates are hiding. This dataset is about to get a clean remix! 🎷🔍\n\n## 4.6 Duplicate Patients\n\nAlright, buckle up, because we're about to dive into the mystery of the duplicate `patient_id` records. Picture this: you're flipping through your dataset like a detective, and suddenly, you stumble upon some suspicious duplicates. But fear not, because we've got just the solution to unravel this enigma.\n\nWe're borrowing a slick move from the data science playbook, courtesy of the wizards over at Stack Overflow. This little trick is like shining a spotlight on the shadows, revealing all the duplicate items lurking in the shadows of our dataset. With this solution in hand, we'll shine a light on those repeat offenders and get to the bottom of this duplication dilemma. So, get ready to crack the case and uncover the truth behind those duplicate patients! 🕵️‍♂️🔍\n\n- borrow from https://stackoverflow.com/questions/14657241/how-do-i-get-a-list-of-all-the-duplicate-items-using-pandas-in-python\n\n```python\ndf[df.patient_id.duplicated(keep=False)].sort_values(\"patient_id\")\n```\n\n\u003cdiv\u003e\n\u003cstyle scoped\u003e\n .dataframe tbody tr th:only-of-type {\n vertical-align: middle;\n }\n .dataframe tbody tr th {\n vertical-align: top;\n }\n .dataframe thead th {\n text-align: right;\n }\n\u003c/style\u003e\n\u003ctable border=\"1\" class=\"dataframe\"\u003e\n \u003cthead\u003e\n \u003ctr style=\"text-align: right;\"\u003e\n \u003cth\u003e\u003c/th\u003e\n \u003cth\u003epatient_id\u003c/th\u003e\n \u003cth\u003eclump_thickness\u003c/th\u003e\n \u003cth\u003ecell_size_uniformity\u003c/th\u003e\n \u003cth\u003ecell_shape_uniformity\u003c/th\u003e\n \u003cth\u003emarginal_adhesion\u003c/th\u003e\n \u003cth\u003esingle_ep_cell_size\u003c/th\u003e\n \u003cth\u003ebare_nuclei\u003c/th\u003e\n \u003cth\u003ebland_chromatin\u003c/th\u003e\n \u003cth\u003enormal_nucleoli\u003c/th\u003e\n \u003cth\u003emitoses\u003c/th\u003e\n \u003cth\u003eclass\u003c/th\u003e\n \u003cth\u003edoctor_name\u003c/th\u003e\n \u003c/tr\u003e\n \u003c/thead\u003e\n \u003ctbody\u003e\n \u003ctr\u003e\n \u003cth\u003e267\u003c/th\u003e\n \u003ctd\u003e320675\u003c/td\u003e\n \u003ctd\u003e3.0\u003c/td\u003e\n \u003ctd\u003e3.0\u003c/td\u003e\n \u003ctd\u003e5\u003c/td\u003e\n \u003ctd\u003e2\u003c/td\u003e\n \u003ctd\u003e3\u003c/td\u003e\n \u003ctd\u003e10\u003c/td\u003e\n \u003ctd\u003e7.0\u003c/td\u003e\n \u003ctd\u003e1.0\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003emalignant\u003c/td\u003e\n \u003ctd\u003eDr. Wong\u003c/td\u003e\n \u003c/tr\u003e\n \u003ctr\u003e\n \u003cth\u003e272\u003c/th\u003e\n \u003ctd\u003e320675\u003c/td\u003e\n \u003ctd\u003e3.0\u003c/td\u003e\n \u003ctd\u003e3.0\u003c/td\u003e\n \u003ctd\u003e5\u003c/td\u003e\n \u003ctd\u003e2\u003c/td\u003e\n \u003ctd\u003e3\u003c/td\u003e\n \u003ctd\u003e10\u003c/td\u003e\n \u003ctd\u003e7.0\u003c/td\u003e\n \u003ctd\u003e1.0\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003emalignant\u003c/td\u003e\n \u003ctd\u003eDr. Smith\u003c/td\u003e\n \u003c/tr\u003e\n \u003ctr\u003e\n \u003cth\u003e575\u003c/th\u003e\n \u003ctd\u003e385103\u003c/td\u003e\n \u003ctd\u003e5.0\u003c/td\u003e\n \u003ctd\u003e1.0\u003c/td\u003e\n \u003ctd\u003e2\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003e2\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003e3.0\u003c/td\u003e\n \u003ctd\u003e1.0\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003ebenign\u003c/td\u003e\n \u003ctd\u003eDr. Smith\u003c/td\u003e\n \u003c/tr\u003e\n \u003ctr\u003e\n \u003cth\u003e269\u003c/th\u003e\n \u003ctd\u003e385103\u003c/td\u003e\n \u003ctd\u003e1.0\u003c/td\u003e\n \u003ctd\u003e1.0\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003e2\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003e3.0\u003c/td\u003e\n \u003ctd\u003e1.0\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003ebenign\u003c/td\u003e\n \u003ctd\u003eDr. Doe\u003c/td\u003e\n \u003c/tr\u003e\n \u003ctr\u003e\n \u003cth\u003e271\u003c/th\u003e\n \u003ctd\u003e411453\u003c/td\u003e\n \u003ctd\u003e5.0\u003c/td\u003e\n \u003ctd\u003e1.0\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003e2\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003e3.0\u003c/td\u003e\n \u003ctd\u003e1.0\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003ebenign\u003c/td\u003e\n \u003ctd\u003eDr. Wong\u003c/td\u003e\n \u003c/tr\u003e\n \u003ctr\u003e\n \u003cth\u003e...\u003c/th\u003e\n \u003ctd\u003e...\u003c/td\u003e\n \u003ctd\u003e...\u003c/td\u003e\n \u003ctd\u003e...\u003c/td\u003e\n \u003ctd\u003e...\u003c/td\u003e\n \u003ctd\u003e...\u003c/td\u003e\n \u003ctd\u003e...\u003c/td\u003e\n \u003ctd\u003e...\u003c/td\u003e\n \u003ctd\u003e...\u003c/td\u003e\n \u003ctd\u003e...\u003c/td\u003e\n \u003ctd\u003e...\u003c/td\u003e\n \u003ctd\u003e...\u003c/td\u003e\n \u003ctd\u003e...\u003c/td\u003e\n \u003c/tr\u003e\n \u003ctr\u003e\n \u003cth\u003e560\u003c/th\u003e\n \u003ctd\u003e1321942\u003c/td\u003e\n \u003ctd\u003e5.0\u003c/td\u003e\n \u003ctd\u003e1.0\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003e2\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003e3.0\u003c/td\u003e\n \u003ctd\u003e1.0\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003ebenign\u003c/td\u003e\n \u003ctd\u003eDr. Doe\u003c/td\u003e\n \u003c/tr\u003e\n \u003ctr\u003e\n \u003cth\u003e660\u003c/th\u003e\n \u003ctd\u003e1339781\u003c/td\u003e\n \u003ctd\u003e1.0\u003c/td\u003e\n \u003ctd\u003e1.0\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003e2\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003e2.0\u003c/td\u003e\n \u003ctd\u003e1.0\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003ebenign\u003c/td\u003e\n \u003ctd\u003eDr. Lee\u003c/td\u003e\n \u003c/tr\u003e\n \u003ctr\u003e\n \u003cth\u003e661\u003c/th\u003e\n \u003ctd\u003e1339781\u003c/td\u003e\n \u003ctd\u003e4.0\u003c/td\u003e\n \u003ctd\u003e1.0\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003e2\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003e3.0\u003c/td\u003e\n \u003ctd\u003e1.0\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003ebenign\u003c/td\u003e\n \u003ctd\u003eDr. Smith\u003c/td\u003e\n \u003c/tr\u003e\n \u003ctr\u003e\n \u003cth\u003e672\u003c/th\u003e\n \u003ctd\u003e1354840\u003c/td\u003e\n \u003ctd\u003e2.0\u003c/td\u003e\n \u003ctd\u003e1.0\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003e2\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003e3.0\u003c/td\u003e\n \u003ctd\u003e1.0\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003ebenign\u003c/td\u003e\n \u003ctd\u003eDr. Wong\u003c/td\u003e\n \u003c/tr\u003e\n \u003ctr\u003e\n \u003cth\u003e673\u003c/th\u003e\n \u003ctd\u003e1354840\u003c/td\u003e\n \u003ctd\u003e5.0\u003c/td\u003e\n \u003ctd\u003e3.0\u003c/td\u003e\n \u003ctd\u003e2\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003e3\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003e1.0\u003c/td\u003e\n \u003ctd\u003e1.0\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003ebenign\u003c/td\u003e\n \u003ctd\u003eDr. Lee\u003c/td\u003e\n \u003c/tr\u003e\n \u003c/tbody\u003e\n\u003c/table\u003e\n\u003cp\u003e98 rows × 12 columns\u003c/p\u003e\n\u003c/div\u003e\n\nAlright, check this out: we've got a little situation on our hands. It seems like we've got `98` patient IDs making multiple appearances in our dataset. Some are showing up twice, while others are pulling off the triple play. Now, wouldn't it be sweet if we could get the lowdown on exactly how many times each patient ID is making a cameo?\n\nWell, guess what? We're about to dive into the nitty-gritty and unravel this mystery. Picture this: we're peeling back the layers of duplication, analyzing each instance to tally up the total count. It's like detective work for data scientists—sleuthing through the numbers to uncover the truth. So, grab your magnifying glass and let's crack this case wide open. We're diving deep into the world of duplications, ready to count 'em up and bring clarity to our dataset! 🕵️‍♂️🔍\n\n## 4.7 Duplicate Records\n\nLet's analyze how many times a single `patient_id` value, was being recorded more than once, in the next table.\n\n- borrow from https://stackoverflow.com/questions/38309729/count-unique-values-with-pandas-per-groups\n\n```python\ndf.patient_id.value_counts()\n```\n\n patient_id\n 1182404 6\n 1276091 5\n 1198641 3\n 897471 2\n 411453 2\n ..\n 1231706 1\n 1232225 1\n 1236043 1\n 1241232 1\n 809912 1\n Name: count, Length: 637, dtype: int64\n\nSurpisingly, some are getting recorded more than twice, some are even getting recorded 6 times. Let's move on to the next steps on how to deal with them.\n\n```python\ndf.drop_duplicates(subset=\"patient_id\", keep='first', inplace = True)\ndf # let's print them.\n```\n\n\u003cdiv\u003e\n\u003cstyle scoped\u003e\n .dataframe tbody tr th:only-of-type {\n vertical-align: middle;\n }\n .dataframe tbody tr th {\n vertical-align: top;\n }\n .dataframe thead th {\n text-align: right;\n }\n\u003c/style\u003e\n\u003ctable border=\"1\" class=\"dataframe\"\u003e\n \u003cthead\u003e\n \u003ctr style=\"text-align: right;\"\u003e\n \u003cth\u003e\u003c/th\u003e\n \u003cth\u003epatient_id\u003c/th\u003e\n \u003cth\u003eclump_thickness\u003c/th\u003e\n \u003cth\u003ecell_size_uniformity\u003c/th\u003e\n \u003cth\u003ecell_shape_uniformity\u003c/th\u003e\n \u003cth\u003emarginal_adhesion\u003c/th\u003e\n \u003cth\u003esingle_ep_cell_size\u003c/th\u003e\n \u003cth\u003ebare_nuclei\u003c/th\u003e\n \u003cth\u003ebland_chromatin\u003c/th\u003e\n \u003cth\u003enormal_nucleoli\u003c/th\u003e\n \u003cth\u003emitoses\u003c/th\u003e\n \u003cth\u003eclass\u003c/th\u003e\n \u003cth\u003edoctor_name\u003c/th\u003e\n \u003c/tr\u003e\n \u003c/thead\u003e\n \u003ctbody\u003e\n \u003ctr\u003e\n \u003cth\u003e0\u003c/th\u003e\n \u003ctd\u003e1000025\u003c/td\u003e\n \u003ctd\u003e5.0\u003c/td\u003e\n \u003ctd\u003e1.0\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003e2\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003e3.0\u003c/td\u003e\n \u003ctd\u003e1.0\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003ebenign\u003c/td\u003e\n \u003ctd\u003eDr. Doe\u003c/td\u003e\n \u003c/tr\u003e\n \u003ctr\u003e\n \u003cth\u003e1\u003c/th\u003e\n \u003ctd\u003e1002945\u003c/td\u003e\n \u003ctd\u003e5.0\u003c/td\u003e\n \u003ctd\u003e4.0\u003c/td\u003e\n \u003ctd\u003e4\u003c/td\u003e\n \u003ctd\u003e5\u003c/td\u003e\n \u003ctd\u003e7\u003c/td\u003e\n \u003ctd\u003e10\u003c/td\u003e\n \u003ctd\u003e3.0\u003c/td\u003e\n \u003ctd\u003e2.0\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003ebenign\u003c/td\u003e\n \u003ctd\u003eDr. Smith\u003c/td\u003e\n \u003c/tr\u003e\n \u003ctr\u003e\n \u003cth\u003e2\u003c/th\u003e\n \u003ctd\u003e1015425\u003c/td\u003e\n \u003ctd\u003e3.0\u003c/td\u003e\n \u003ctd\u003e1.0\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003e2\u003c/td\u003e\n \u003ctd\u003e2\u003c/td\u003e\n \u003ctd\u003e3.0\u003c/td\u003e\n \u003ctd\u003e1.0\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003ebenign\u003c/td\u003e\n \u003ctd\u003eDr. Lee\u003c/td\u003e\n \u003c/tr\u003e\n \u003ctr\u003e\n \u003cth\u003e3\u003c/th\u003e\n \u003ctd\u003e1016277\u003c/td\u003e\n \u003ctd\u003e6.0\u003c/td\u003e\n \u003ctd\u003e8.0\u003c/td\u003e\n \u003ctd\u003e8\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003e3\u003c/td\u003e\n \u003ctd\u003e4\u003c/td\u003e\n \u003ctd\u003e3.0\u003c/td\u003e\n \u003ctd\u003e7.0\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003ebenign\u003c/td\u003e\n \u003ctd\u003eDr. Smith\u003c/td\u003e\n \u003c/tr\u003e\n \u003ctr\u003e\n \u003cth\u003e4\u003c/th\u003e\n \u003ctd\u003e1017023\u003c/td\u003e\n \u003ctd\u003e4.0\u003c/td\u003e\n \u003ctd\u003e1.0\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003e3\u003c/td\u003e\n \u003ctd\u003e2\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003e3.0\u003c/td\u003e\n \u003ctd\u003e1.0\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003ebenign\u003c/td\u003e\n \u003ctd\u003eDr. Wong\u003c/td\u003e\n \u003c/tr\u003e\n \u003ctr\u003e\n \u003cth\u003e...\u003c/th\u003e\n \u003ctd\u003e...\u003c/td\u003e\n \u003ctd\u003e...\u003c/td\u003e\n \u003ctd\u003e...\u003c/td\u003e\n \u003ctd\u003e...\u003c/td\u003e\n \u003ctd\u003e...\u003c/td\u003e\n \u003ctd\u003e...\u003c/td\u003e\n \u003ctd\u003e...\u003c/td\u003e\n \u003ctd\u003e...\u003c/td\u003e\n \u003ctd\u003e...\u003c/td\u003e\n \u003ctd\u003e...\u003c/td\u003e\n \u003ctd\u003e...\u003c/td\u003e\n \u003ctd\u003e...\u003c/td\u003e\n \u003c/tr\u003e\n \u003ctr\u003e\n \u003cth\u003e693\u003c/th\u003e\n \u003ctd\u003e763235\u003c/td\u003e\n \u003ctd\u003e3.0\u003c/td\u003e\n \u003ctd\u003e1.0\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003e2\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003e2.0\u003c/td\u003e\n \u003ctd\u003e1.0\u003c/td\u003e\n \u003ctd\u003e2\u003c/td\u003e\n \u003ctd\u003ebenign\u003c/td\u003e\n \u003ctd\u003eDr. Lee\u003c/td\u003e\n \u003c/tr\u003e\n \u003ctr\u003e\n \u003cth\u003e694\u003c/th\u003e\n \u003ctd\u003e776715\u003c/td\u003e\n \u003ctd\u003e3.0\u003c/td\u003e\n \u003ctd\u003e1.0\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003e3\u003c/td\u003e\n \u003ctd\u003e2\u003c/td\u003e\n \u003ctd\u003e1.0\u003c/td\u003e\n \u003ctd\u003e1.0\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003ebenign\u003c/td\u003e\n \u003ctd\u003eDr. Lee\u003c/td\u003e\n \u003c/tr\u003e\n \u003ctr\u003e\n \u003cth\u003e695\u003c/th\u003e\n \u003ctd\u003e841769\u003c/td\u003e\n \u003ctd\u003e2.0\u003c/td\u003e\n \u003ctd\u003e1.0\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003e2\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003e1.0\u003c/td\u003e\n \u003ctd\u003e1.0\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003ebenign\u003c/td\u003e\n \u003ctd\u003eDr. Smith\u003c/td\u003e\n \u003c/tr\u003e\n \u003ctr\u003e\n \u003cth\u003e696\u003c/th\u003e\n \u003ctd\u003e888820\u003c/td\u003e\n \u003ctd\u003e5.0\u003c/td\u003e\n \u003ctd\u003e10.0\u003c/td\u003e\n \u003ctd\u003e10\u003c/td\u003e\n \u003ctd\u003e3\u003c/td\u003e\n \u003ctd\u003e7\u003c/td\u003e\n \u003ctd\u003e3\u003c/td\u003e\n \u003ctd\u003e8.0\u003c/td\u003e\n \u003ctd\u003e10.0\u003c/td\u003e\n \u003ctd\u003e2\u003c/td\u003e\n \u003ctd\u003emalignant\u003c/td\u003e\n \u003ctd\u003eDr. Lee\u003c/td\u003e\n \u003c/tr\u003e\n \u003ctr\u003e\n \u003cth\u003e697\u003c/th\u003e\n \u003ctd\u003e897471\u003c/td\u003e\n \u003ctd\u003e4.0\u003c/td\u003e\n \u003ctd\u003e8.0\u003c/td\u003e\n \u003ctd\u003e6\u003c/td\u003e\n \u003ctd\u003e4\u003c/td\u003e\n \u003ctd\u003e3\u003c/td\u003e\n \u003ctd\u003e4\u003c/td\u003e\n \u003ctd\u003e10.0\u003c/td\u003e\n \u003ctd\u003e6.0\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003emalignant\u003c/td\u003e\n \u003ctd\u003eDr. Lee\u003c/td\u003e\n \u003c/tr\u003e\n \u003c/tbody\u003e\n\u003c/table\u003e\n\u003cp\u003e637 rows × 12 columns\u003c/p\u003e\n\u003c/div\u003e\n\nGreat, the above code just left us with one clean and no duplicated rows of data. Now the records are down from `690` to `637`. Now let's check wheter their still duplicates from the previous list of `patient_id` we had queried earlier, let's try the `1182404` `patient_id` string for that matter.\n\n```python\n# let's check whether the 1182404 patient_id still has duplication.\ndf.loc[df['patient_id'] == 1182404]\n```\n\n\u003cdiv\u003e\n\u003cstyle scoped\u003e\n .dataframe tbody tr th:only-of-type {\n vertical-align: middle;\n }\n .dataframe tbody tr th {\n vertical-align: top;\n }\n .dataframe thead th {\n text-align: right;\n }\n\u003c/style\u003e\n\u003ctable border=\"1\" class=\"dataframe\"\u003e\n \u003cthead\u003e\n \u003ctr style=\"text-align: right;\"\u003e\n \u003cth\u003e\u003c/th\u003e\n \u003cth\u003epatient_id\u003c/th\u003e\n \u003cth\u003eclump_thickness\u003c/th\u003e\n \u003cth\u003ecell_size_uniformity\u003c/th\u003e\n \u003cth\u003ecell_shape_uniformity\u003c/th\u003e\n \u003cth\u003emarginal_adhesion\u003c/th\u003e\n \u003cth\u003esingle_ep_cell_size\u003c/th\u003e\n \u003cth\u003ebare_nuclei\u003c/th\u003e\n \u003cth\u003ebland_chromatin\u003c/th\u003e\n \u003cth\u003enormal_nucleoli\u003c/th\u003e\n \u003cth\u003emitoses\u003c/th\u003e\n \u003cth\u003eclass\u003c/th\u003e\n \u003cth\u003edoctor_name\u003c/th\u003e\n \u003c/tr\u003e\n \u003c/thead\u003e\n \u003ctbody\u003e\n \u003ctr\u003e\n \u003cth\u003e136\u003c/th\u003e\n \u003ctd\u003e1182404\u003c/td\u003e\n \u003ctd\u003e4.0\u003c/td\u003e\n \u003ctd\u003e1.0\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003e2\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003e2.0\u003c/td\u003e\n \u003ctd\u003e1.0\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003ebenign\u003c/td\u003e\n \u003ctd\u003eDr. Lee\u003c/td\u003e\n \u003c/tr\u003e\n \u003c/tbody\u003e\n\u003c/table\u003e\n\u003c/div\u003e\n\n```python\ndf.isnull().values.any()\n```\n\n False\n\n# 5. Visual Analysis\n\nAnd they say, picture says a thousand words. And I couldn't agree more with the statement, we as a human easily absorb information, through graphs, colors and visualization, in contrast to just plain numbers. In this section, let's try to visualize our findings better.\n\nThere are numerous great visualization libraries out there for both Python and Pandas, but I've been experimenting with Seaborn for awhile, and found them somewhat easier to implement to our objectives. Here are some of the benefit of having Seaborn as your library of choice for visualtization as taken from the official homepage:\n\n\u003e Seaborn aims to make visualization a central part of exploring and understanding data. Its dataset-oriented plotting \u003e functions operate on dataframes and arrays containing whole datasets and internally perform the necessary semantic\n\u003e mapping and statistical aggregation to produce informative plots.\n\nHere is some of the functionality that seaborn offers:\n\n- A dataset-oriented API for examining [relationships](https://seaborn.pydata.org/examples/scatter_bubbles.html#scatter-bubbles) between [multiple variables](https://seaborn.pydata.org/examples/faceted_lineplot.html#faceted-lineplot)\n- Specialized support for using categorical variables to show [observations](https://seaborn.pydata.org/examples/jitter_stripplot.html#jitter-stripplot) or [aggregate statistics](https://seaborn.pydata.org/examples/pointplot_anova.html#pointplot-anova)\n- Options for visualizing [univariate](https://seaborn.pydata.org/examples/distplot_options.html#distplot-options) or [bivariate](https://seaborn.pydata.org/examples/joint_kde.html#joint-kde) distributions and for [comparing](https://seaborn.pydata.org/examples/horizontal_boxplot.html#horizontal-boxplot) them between subsets of data\n- Automatic estimation and plotting of [linear regression](https://seaborn.pydata.org/examples/anscombes_quartet.html#anscombes-quartet) models for different kinds [dependent](https://seaborn.pydata.org/examples/logistic_regression.html#logistic-regression) variables\n- Convenient views onto the overall [structure](https://seaborn.pydata.org/examples/scatterplot_matrix.html#scatterplot-matrix) of complex datasets\n- High-level abstractions for structuring [multi-plot grids](https://seaborn.pydata.org/examples/faceted_histogram.html#faceted-histogram) that let you easily build [complex](https://seaborn.pydata.org/examples/pair_grid_with_kde.html#pair-grid-with-kde) visualizations\n- Concise control over matplotlib figure styling with several [built-in themes](https://seaborn.pydata.org/tutorial/aesthetics.html#aesthetics-tutorial)\n- Tools for choosing [color palettes](https://seaborn.pydata.org/tutorial/color_palettes.html#palette-tutorial) that faithfully reveal patterns in your data\n\n## 5.2 Patients for Each Doctor?\n\nEver wonder how many patients each doctor handled from the dataset? We know for sure, we have 4 doctors from the dataset, but haven't got some perfect ideas on how many patients each doctor is handling them. So why don't we try to visualize them, to see how many patients for each doctor needs to handle from the dataset?\n\n```python\ndf['doctor_name'].value_counts()\n```\n\n doctor_name\n Dr. Doe 167\n Dr. Lee 165\n Dr. Smith 164\n Dr. Wong 141\n Name: count, dtype: int64\n\n```python\ndf['patient_id'].count()\n```\n\n 637\n\n```python\n# updated code\nimport matplotlib.pyplot as plt\nimport seaborn as sns\nimport pandas as pd\n\n# Define the dimensions of the figure\nfig_dims = (12, 6)\nfig, ax = plt.subplots(figsize=fig_dims)\n\n# Set titles and labels\nax.set_title(\"How Many Patients Per Doctor\", fontsize=14)\nax.set_xlabel('Doctor Name', fontsize=12)\nax.set_ylabel('Patients', fontsize=12)\n\n# Set Seaborn style and despine the plot\nsns.set_style('whitegrid')\nsns.despine()\n\n# Create countplot\nsns.countplot(x='doctor_name', hue='doctor_name', palette='RdBu_r', data=df, dodge=False, legend=False)\n\n# Show the plot\nplt.show()\n```\n\n![png](images/output_62_0.png)\n\n- `Dr. Doe` :167\n- `Dr. Lee` :165\n- `Dr. Smith`:164\n- `Dr. Wong` :141\n\n## 5.3 Class Cases For Each Doctor?\n\nAs mentioned on the earlier sections, we have a column name `class`, which basically contains the value of either `benign` and `malignant`. We wish to understand further whether a person's tumor is `malignant` (cancerous) or `benign` (not cancerous). With that being said, let's get down to business and try to visualize them further down below.\n\n```python\n# Print the column names of the DataFrame to check for the correct column name\nprint(df.columns)\n```\n\n Index(['patient_id', 'clump_thickness', 'cell_size_uniformity',\n 'cell_shape_uniformity', 'marginal_adhesion', 'single_ep_cell_size',\n 'bare_nuclei', 'bland_chromatin', 'normal_nucleoli', 'mitoses', 'class',\n 'doctor_name'],\n dtype='object')\n\n```python\ndf.columns = df.columns.str.strip()\nprint(df.columns)\n```\n\n Index(['patient_id', 'clump_thickness', 'cell_size_uniformity',\n 'cell_shape_uniformity', 'marginal_adhesion', 'single_ep_cell_size',\n 'bare_nuclei', 'bland_chromatin', 'normal_nucleoli', 'mitoses', 'class',\n 'doctor_name'],\n dtype='object')\n\n```python\n# class_by_doctor = df[(\"class\")].value_counts()\n# class_by_doctor\n\nif 'class' in df.columns:\n class_by_doctor = df['class'].value_counts()\n print(class_by_doctor)\nelse:\n print(\"The 'class' column is not present in the DataFrame.\")\n```\n\n class\n benign 407\n malignant 230\n Name: count, dtype: int64\n\n```python\nimport matplotlib.pyplot as plt\nimport seaborn as sns\n\n# updated code\nfig_dims = (12, 6)\nfig, ax = plt.subplots(figsize=fig_dims)\n\nax.set_title(\"Patient with Cancer Syndrome Per Doctor\", fontsize=15)\nax.set_xlabel('X_axis', fontsize=12)\nax.set_ylabel('Y_axis', fontsize=12)\n\nsns.despine()\nsns.set_style('whitegrid')\nsns.barplot(x=\"class\", y=\"patient_id\", hue=\"doctor_name\", errorbar=None, palette='RdBu_r', data=df)\n\nplt.show()\n\n```\n\n![png](images/output_68_0.png)\n\n```python\n# This time, let's do them horizontally\n\n# updated code\nax.set_title(\"Class of Patient Per Doctor\", fontsize=15)\nax.set_xlabel('Doctor Name', fontsize=12)\nax.set_ylabel('Patients', fontsize=12)\n\nsns.despine()\nsns.set_style('whitegrid')\nsns.barplot(x=\"patient_id\", y=\"class\", hue=\"doctor_name\", errorbar=None, palette='RdBu_r', data=df)\n\nplt.show()\n```\n\n![png](images/output_69_0.png)\n\n## 5.4 Class Case Per Doctor?\n\nAs mentioned on the earlier sections, we have a column name `class`, which basically contains the value of `benign` and `malignant`. We wish to understand further whether a person's tumor is `malignant` (cancerous) or `benign` (not cancerous). With that being said, let's get down to business and try to visualize them further down below.\n\n```python\n# udpated code\nimport matplotlib.pyplot as plt\nimport seaborn as sns\n\n# Define the figure dimensions\nfig_dims = (12, 6)\nfig, ax = plt.subplots(figsize=fig_dims)\n\n# Set plot title and labels\nax.set_title(\"Class Per Doctor\", fontsize=15)\nax.set_xlabel('Doctor Name', fontsize=12)\nax.set_ylabel('Patients', fontsize=12)\n\n# Set style and despine\nsns.set_style('whitegrid')\nsns.despine()\n\n# Create the barplot with the updated parameter\nsns.barplot(x='doctor_name', y='patient_id', hue='class', errorbar=None, palette='RdBu_r', data=df)\n\n# Show the plot\nplt.show()\n```\n\n![png](images/output_71_0.png)\n\n```python\n# updated code\nfig_dims = (12, 6)\nfig, ax = plt.subplots(figsize=fig_dims)\n\nax.set_title(\"Horizontal Classes Per Doctor\", fontsize=15)\nax.set_xlabel('Doctor Name', fontsize=12)\nax.set_ylabel('Patients', fontsize=12)\n\nsns.despine()\nsns.set_style('whitegrid')\nsns.barplot(y='doctor_name', x='patient_id', hue='class', errorbar=None, palette='RdBu_r', data=df)\n\nplt.show()\n```\n\n![png](images/output_72_0.png)\n\n```python\ndf.isnull().values.any()\ndf.isnull().sum().sum()\n```\n\n 0\n\n---\n\n# 6. One Hot Encoding\n\nNow that we've gone through the previous topic of visualizing our dataset, let's continue to the next section of preparing them in a way that our machine learning algorithms, by which will be using them near the end of this article, would be able to pick them up and run them through our `predictive model` easily. You may ask, \"Of all the previous process, they're not enough?\". Well apparently, it's not sufficient enough to meet the standards.\n\nAs among one of the challenges that we're facing is still within the dataset itself. We'll be better off by modifying them to meet the requirements. Our dataset still consist some categorical values in them, the `doctors_name` and `class` columns are two of good examples. And Machine Learning algorithm don't normally like them. We need to modify these two columns, so that it would make it easier and less confusing for the machine learning model to process through. I came across this [great example](https://medium.com/@contactsunny/label-encoder-vs-one-hot-encoder-in-machine-learning-3fc273365621) on how to deal with the similar situation.\n\n## 6.1 `doctor_name` column.\n\nLet's first try to deal with the `doctor_name` column. This particular consist of 4 distinct values in them and how Pandas would handle them would probably as an object rather than an integer. Let's have our work around for this particular area. Will create another variable and call it `doctors_hotEncoded` and use the `get_dummies` method to transform them to an encoded one.\n\n```python\ndoctors_hotEncoded = pd.get_dummies(df['doctor_name'])\n```\n\n```python\ndoctors_hotEncoded\n```\n\n\u003cdiv\u003e\n\u003cstyle scoped\u003e\n .dataframe tbody tr th:only-of-type {\n vertical-align: middle;\n }\n .dataframe tbody tr th {\n vertical-align: top;\n }\n .dataframe thead th {\n text-align: right;\n }\n\u003c/style\u003e\n\u003ctable border=\"1\" class=\"dataframe\"\u003e\n \u003cthead\u003e\n \u003ctr style=\"text-align: right;\"\u003e\n \u003cth\u003e\u003c/th\u003e\n \u003cth\u003eDr. Doe\u003c/th\u003e\n \u003cth\u003eDr. Lee\u003c/th\u003e\n \u003cth\u003eDr. Smith\u003c/th\u003e\n \u003cth\u003eDr. Wong\u003c/th\u003e\n \u003c/tr\u003e\n \u003c/thead\u003e\n \u003ctbody\u003e\n \u003ctr\u003e\n \u003cth\u003e0\u003c/th\u003e\n \u003ctd\u003eTrue\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003c/tr\u003e\n \u003ctr\u003e\n \u003cth\u003e1\u003c/th\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eTrue\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003c/tr\u003e\n \u003ctr\u003e\n \u003cth\u003e2\u003c/th\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eTrue\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003c/tr\u003e\n \u003ctr\u003e\n \u003cth\u003e3\u003c/th\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eTrue\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003c/tr\u003e\n \u003ctr\u003e\n \u003cth\u003e4\u003c/th\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eTrue\u003c/td\u003e\n \u003c/tr\u003e\n \u003ctr\u003e\n \u003cth\u003e...\u003c/th\u003e\n \u003ctd\u003e...\u003c/td\u003e\n \u003ctd\u003e...\u003c/td\u003e\n \u003ctd\u003e...\u003c/td\u003e\n \u003ctd\u003e...\u003c/td\u003e\n \u003c/tr\u003e\n \u003ctr\u003e\n \u003cth\u003e693\u003c/th\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eTrue\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003c/tr\u003e\n \u003ctr\u003e\n \u003cth\u003e694\u003c/th\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eTrue\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003c/tr\u003e\n \u003ctr\u003e\n \u003cth\u003e695\u003c/th\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eTrue\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003c/tr\u003e\n \u003ctr\u003e\n \u003cth\u003e696\u003c/th\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eTrue\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003c/tr\u003e\n \u003ctr\u003e\n \u003cth\u003e697\u003c/th\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eTrue\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003c/tr\u003e\n \u003c/tbody\u003e\n\u003c/table\u003e\n\u003cp\u003e637 rows × 4 columns\u003c/p\u003e\n\u003c/div\u003e\n\n```python\ncombined_doctors_hotEncoded_df = pd.concat([df, doctors_hotEncoded], axis=1)\n```\n\n```python\ncombined_doctors_hotEncoded_df\n```\n\n\u003cdiv\u003e\n\u003cstyle scoped\u003e\n .dataframe tbody tr th:only-of-type {\n vertical-align: middle;\n }\n .dataframe tbody tr th {\n vertical-align: top;\n }\n .dataframe thead th {\n text-align: right;\n }\n\u003c/style\u003e\n\u003ctable border=\"1\" class=\"dataframe\"\u003e\n \u003cthead\u003e\n \u003ctr style=\"text-align: right;\"\u003e\n \u003cth\u003e\u003c/th\u003e\n \u003cth\u003epatient_id\u003c/th\u003e\n \u003cth\u003eclump_thickness\u003c/th\u003e\n \u003cth\u003ecell_size_uniformity\u003c/th\u003e\n \u003cth\u003ecell_shape_uniformity\u003c/th\u003e\n \u003cth\u003emarginal_adhesion\u003c/th\u003e\n \u003cth\u003esingle_ep_cell_size\u003c/th\u003e\n \u003cth\u003ebare_nuclei\u003c/th\u003e\n \u003cth\u003ebland_chromatin\u003c/th\u003e\n \u003cth\u003enormal_nucleoli\u003c/th\u003e\n \u003cth\u003emitoses\u003c/th\u003e\n \u003cth\u003eclass\u003c/th\u003e\n \u003cth\u003edoctor_name\u003c/th\u003e\n \u003cth\u003eDr. Doe\u003c/th\u003e\n \u003cth\u003eDr. Lee\u003c/th\u003e\n \u003cth\u003eDr. Smith\u003c/th\u003e\n \u003cth\u003eDr. Wong\u003c/th\u003e\n \u003c/tr\u003e\n \u003c/thead\u003e\n \u003ctbody\u003e\n \u003ctr\u003e\n \u003cth\u003e0\u003c/th\u003e\n \u003ctd\u003e1000025\u003c/td\u003e\n \u003ctd\u003e5.0\u003c/td\u003e\n \u003ctd\u003e1.0\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003e2\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003e3.0\u003c/td\u003e\n \u003ctd\u003e1.0\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003ebenign\u003c/td\u003e\n \u003ctd\u003eDr. Doe\u003c/td\u003e\n \u003ctd\u003eTrue\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003c/tr\u003e\n \u003ctr\u003e\n \u003cth\u003e1\u003c/th\u003e\n \u003ctd\u003e1002945\u003c/td\u003e\n \u003ctd\u003e5.0\u003c/td\u003e\n \u003ctd\u003e4.0\u003c/td\u003e\n \u003ctd\u003e4\u003c/td\u003e\n \u003ctd\u003e5\u003c/td\u003e\n \u003ctd\u003e7\u003c/td\u003e\n \u003ctd\u003e10\u003c/td\u003e\n \u003ctd\u003e3.0\u003c/td\u003e\n \u003ctd\u003e2.0\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003ebenign\u003c/td\u003e\n \u003ctd\u003eDr. Smith\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eTrue\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003c/tr\u003e\n \u003ctr\u003e\n \u003cth\u003e2\u003c/th\u003e\n \u003ctd\u003e1015425\u003c/td\u003e\n \u003ctd\u003e3.0\u003c/td\u003e\n \u003ctd\u003e1.0\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003e2\u003c/td\u003e\n \u003ctd\u003e2\u003c/td\u003e\n \u003ctd\u003e3.0\u003c/td\u003e\n \u003ctd\u003e1.0\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003ebenign\u003c/td\u003e\n \u003ctd\u003eDr. Lee\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eTrue\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003c/tr\u003e\n \u003ctr\u003e\n \u003cth\u003e3\u003c/th\u003e\n \u003ctd\u003e1016277\u003c/td\u003e\n \u003ctd\u003e6.0\u003c/td\u003e\n \u003ctd\u003e8.0\u003c/td\u003e\n \u003ctd\u003e8\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003e3\u003c/td\u003e\n \u003ctd\u003e4\u003c/td\u003e\n \u003ctd\u003e3.0\u003c/td\u003e\n \u003ctd\u003e7.0\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003ebenign\u003c/td\u003e\n \u003ctd\u003eDr. Smith\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eTrue\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003c/tr\u003e\n \u003ctr\u003e\n \u003cth\u003e4\u003c/th\u003e\n \u003ctd\u003e1017023\u003c/td\u003e\n \u003ctd\u003e4.0\u003c/td\u003e\n \u003ctd\u003e1.0\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003e3\u003c/td\u003e\n \u003ctd\u003e2\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003e3.0\u003c/td\u003e\n \u003ctd\u003e1.0\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003ebenign\u003c/td\u003e\n \u003ctd\u003eDr. Wong\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eTrue\u003c/td\u003e\n \u003c/tr\u003e\n \u003ctr\u003e\n \u003cth\u003e...\u003c/th\u003e\n \u003ctd\u003e...\u003c/td\u003e\n \u003ctd\u003e...\u003c/td\u003e\n \u003ctd\u003e...\u003c/td\u003e\n \u003ctd\u003e...\u003c/td\u003e\n \u003ctd\u003e...\u003c/td\u003e\n \u003ctd\u003e...\u003c/td\u003e\n \u003ctd\u003e...\u003c/td\u003e\n \u003ctd\u003e...\u003c/td\u003e\n \u003ctd\u003e...\u003c/td\u003e\n \u003ctd\u003e...\u003c/td\u003e\n \u003ctd\u003e...\u003c/td\u003e\n \u003ctd\u003e...\u003c/td\u003e\n \u003ctd\u003e...\u003c/td\u003e\n \u003ctd\u003e...\u003c/td\u003e\n \u003ctd\u003e...\u003c/td\u003e\n \u003ctd\u003e...\u003c/td\u003e\n \u003c/tr\u003e\n \u003ctr\u003e\n \u003cth\u003e693\u003c/th\u003e\n \u003ctd\u003e763235\u003c/td\u003e\n \u003ctd\u003e3.0\u003c/td\u003e\n \u003ctd\u003e1.0\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003e2\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003e2.0\u003c/td\u003e\n \u003ctd\u003e1.0\u003c/td\u003e\n \u003ctd\u003e2\u003c/td\u003e\n \u003ctd\u003ebenign\u003c/td\u003e\n \u003ctd\u003eDr. Lee\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eTrue\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003c/tr\u003e\n \u003ctr\u003e\n \u003cth\u003e694\u003c/th\u003e\n \u003ctd\u003e776715\u003c/td\u003e\n \u003ctd\u003e3.0\u003c/td\u003e\n \u003ctd\u003e1.0\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003e3\u003c/td\u003e\n \u003ctd\u003e2\u003c/td\u003e\n \u003ctd\u003e1.0\u003c/td\u003e\n \u003ctd\u003e1.0\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003ebenign\u003c/td\u003e\n \u003ctd\u003eDr. Lee\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eTrue\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003c/tr\u003e\n \u003ctr\u003e\n \u003cth\u003e695\u003c/th\u003e\n \u003ctd\u003e841769\u003c/td\u003e\n \u003ctd\u003e2.0\u003c/td\u003e\n \u003ctd\u003e1.0\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003e2\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003e1.0\u003c/td\u003e\n \u003ctd\u003e1.0\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003ebenign\u003c/td\u003e\n \u003ctd\u003eDr. Smith\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eTrue\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003c/tr\u003e\n \u003ctr\u003e\n \u003cth\u003e696\u003c/th\u003e\n \u003ctd\u003e888820\u003c/td\u003e\n \u003ctd\u003e5.0\u003c/td\u003e\n \u003ctd\u003e10.0\u003c/td\u003e\n \u003ctd\u003e10\u003c/td\u003e\n \u003ctd\u003e3\u003c/td\u003e\n \u003ctd\u003e7\u003c/td\u003e\n \u003ctd\u003e3\u003c/td\u003e\n \u003ctd\u003e8.0\u003c/td\u003e\n \u003ctd\u003e10.0\u003c/td\u003e\n \u003ctd\u003e2\u003c/td\u003e\n \u003ctd\u003emalignant\u003c/td\u003e\n \u003ctd\u003eDr. Lee\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eTrue\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003c/tr\u003e\n \u003ctr\u003e\n \u003cth\u003e697\u003c/th\u003e\n \u003ctd\u003e897471\u003c/td\u003e\n \u003ctd\u003e4.0\u003c/td\u003e\n \u003ctd\u003e8.0\u003c/td\u003e\n \u003ctd\u003e6\u003c/td\u003e\n \u003ctd\u003e4\u003c/td\u003e\n \u003ctd\u003e3\u003c/td\u003e\n \u003ctd\u003e4\u003c/td\u003e\n \u003ctd\u003e10.0\u003c/td\u003e\n \u003ctd\u003e6.0\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003emalignant\u003c/td\u003e\n \u003ctd\u003eDr. Lee\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eTrue\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003c/tr\u003e\n \u003c/tbody\u003e\n\u003c/table\u003e\n\u003cp\u003e637 rows × 16 columns\u003c/p\u003e\n\u003c/div\u003e\n\n```python\n# Now let's drop the 'doctor_name' varibale\ncombined_doctors_hotEncoded_df = combined_doctors_hotEncoded_df.drop(columns=['doctor_name'])\n```\n\n```python\n# This is how it would look like.\ncombined_doctors_hotEncoded_df\n```\n\n\u003cdiv\u003e\n\u003cstyle scoped\u003e\n .dataframe tbody tr th:only-of-type {\n vertical-align: middle;\n }\n .dataframe tbody tr th {\n vertical-align: top;\n }\n .dataframe thead th {\n text-align: right;\n }\n\u003c/style\u003e\n\u003ctable border=\"1\" class=\"dataframe\"\u003e\n \u003cthead\u003e\n \u003ctr style=\"text-align: right;\"\u003e\n \u003cth\u003e\u003c/th\u003e\n \u003cth\u003epatient_id\u003c/th\u003e\n \u003cth\u003eclump_thickness\u003c/th\u003e\n \u003cth\u003ecell_size_uniformity\u003c/th\u003e\n \u003cth\u003ecell_shape_uniformity\u003c/th\u003e\n \u003cth\u003emarginal_adhesion\u003c/th\u003e\n \u003cth\u003esingle_ep_cell_size\u003c/th\u003e\n \u003cth\u003ebare_nuclei\u003c/th\u003e\n \u003cth\u003ebland_chromatin\u003c/th\u003e\n \u003cth\u003enormal_nucleoli\u003c/th\u003e\n \u003cth\u003emitoses\u003c/th\u003e\n \u003cth\u003eclass\u003c/th\u003e\n \u003cth\u003eDr. Doe\u003c/th\u003e\n \u003cth\u003eDr. Lee\u003c/th\u003e\n \u003cth\u003eDr. Smith\u003c/th\u003e\n \u003cth\u003eDr. Wong\u003c/th\u003e\n \u003c/tr\u003e\n \u003c/thead\u003e\n \u003ctbody\u003e\n \u003ctr\u003e\n \u003cth\u003e0\u003c/th\u003e\n \u003ctd\u003e1000025\u003c/td\u003e\n \u003ctd\u003e5.0\u003c/td\u003e\n \u003ctd\u003e1.0\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003e2\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003e3.0\u003c/td\u003e\n \u003ctd\u003e1.0\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003ebenign\u003c/td\u003e\n \u003ctd\u003eTrue\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003c/tr\u003e\n \u003ctr\u003e\n \u003cth\u003e1\u003c/th\u003e\n \u003ctd\u003e1002945\u003c/td\u003e\n \u003ctd\u003e5.0\u003c/td\u003e\n \u003ctd\u003e4.0\u003c/td\u003e\n \u003ctd\u003e4\u003c/td\u003e\n \u003ctd\u003e5\u003c/td\u003e\n \u003ctd\u003e7\u003c/td\u003e\n \u003ctd\u003e10\u003c/td\u003e\n \u003ctd\u003e3.0\u003c/td\u003e\n \u003ctd\u003e2.0\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003ebenign\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eTrue\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003c/tr\u003e\n \u003ctr\u003e\n \u003cth\u003e2\u003c/th\u003e\n \u003ctd\u003e1015425\u003c/td\u003e\n \u003ctd\u003e3.0\u003c/td\u003e\n \u003ctd\u003e1.0\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003e2\u003c/td\u003e\n \u003ctd\u003e2\u003c/td\u003e\n \u003ctd\u003e3.0\u003c/td\u003e\n \u003ctd\u003e1.0\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003ebenign\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eTrue\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003c/tr\u003e\n \u003ctr\u003e\n \u003cth\u003e3\u003c/th\u003e\n \u003ctd\u003e1016277\u003c/td\u003e\n \u003ctd\u003e6.0\u003c/td\u003e\n \u003ctd\u003e8.0\u003c/td\u003e\n \u003ctd\u003e8\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003e3\u003c/td\u003e\n \u003ctd\u003e4\u003c/td\u003e\n \u003ctd\u003e3.0\u003c/td\u003e\n \u003ctd\u003e7.0\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003ebenign\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eTrue\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003c/tr\u003e\n \u003ctr\u003e\n \u003cth\u003e4\u003c/th\u003e\n \u003ctd\u003e1017023\u003c/td\u003e\n \u003ctd\u003e4.0\u003c/td\u003e\n \u003ctd\u003e1.0\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003e3\u003c/td\u003e\n \u003ctd\u003e2\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003e3.0\u003c/td\u003e\n \u003ctd\u003e1.0\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003ebenign\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eTrue\u003c/td\u003e\n \u003c/tr\u003e\n \u003ctr\u003e\n \u003cth\u003e...\u003c/th\u003e\n \u003ctd\u003e...\u003c/td\u003e\n \u003ctd\u003e...\u003c/td\u003e\n \u003ctd\u003e...\u003c/td\u003e\n \u003ctd\u003e...\u003c/td\u003e\n \u003ctd\u003e...\u003c/td\u003e\n \u003ctd\u003e...\u003c/td\u003e\n \u003ctd\u003e...\u003c/td\u003e\n \u003ctd\u003e...\u003c/td\u003e\n \u003ctd\u003e...\u003c/td\u003e\n \u003ctd\u003e...\u003c/td\u003e\n \u003ctd\u003e...\u003c/td\u003e\n \u003ctd\u003e...\u003c/td\u003e\n \u003ctd\u003e...\u003c/td\u003e\n \u003ctd\u003e...\u003c/td\u003e\n \u003ctd\u003e...\u003c/td\u003e\n \u003c/tr\u003e\n \u003ctr\u003e\n \u003cth\u003e693\u003c/th\u003e\n \u003ctd\u003e763235\u003c/td\u003e\n \u003ctd\u003e3.0\u003c/td\u003e\n \u003ctd\u003e1.0\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003e2\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003e2.0\u003c/td\u003e\n \u003ctd\u003e1.0\u003c/td\u003e\n \u003ctd\u003e2\u003c/td\u003e\n \u003ctd\u003ebenign\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eTrue\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003c/tr\u003e\n \u003ctr\u003e\n \u003cth\u003e694\u003c/th\u003e\n \u003ctd\u003e776715\u003c/td\u003e\n \u003ctd\u003e3.0\u003c/td\u003e\n \u003ctd\u003e1.0\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003e3\u003c/td\u003e\n \u003ctd\u003e2\u003c/td\u003e\n \u003ctd\u003e1.0\u003c/td\u003e\n \u003ctd\u003e1.0\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003ebenign\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eTrue\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003c/tr\u003e\n \u003ctr\u003e\n \u003cth\u003e695\u003c/th\u003e\n \u003ctd\u003e841769\u003c/td\u003e\n \u003ctd\u003e2.0\u003c/td\u003e\n \u003ctd\u003e1.0\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003e2\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003e1.0\u003c/td\u003e\n \u003ctd\u003e1.0\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003ebenign\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eTrue\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003c/tr\u003e\n \u003ctr\u003e\n \u003cth\u003e696\u003c/th\u003e\n \u003ctd\u003e888820\u003c/td\u003e\n \u003ctd\u003e5.0\u003c/td\u003e\n \u003ctd\u003e10.0\u003c/td\u003e\n \u003ctd\u003e10\u003c/td\u003e\n \u003ctd\u003e3\u003c/td\u003e\n \u003ctd\u003e7\u003c/td\u003e\n \u003ctd\u003e3\u003c/td\u003e\n \u003ctd\u003e8.0\u003c/td\u003e\n \u003ctd\u003e10.0\u003c/td\u003e\n \u003ctd\u003e2\u003c/td\u003e\n \u003ctd\u003emalignant\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eTrue\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003c/tr\u003e\n \u003ctr\u003e\n \u003cth\u003e697\u003c/th\u003e\n \u003ctd\u003e897471\u003c/td\u003e\n \u003ctd\u003e4.0\u003c/td\u003e\n \u003ctd\u003e8.0\u003c/td\u003e\n \u003ctd\u003e6\u003c/td\u003e\n \u003ctd\u003e4\u003c/td\u003e\n \u003ctd\u003e3\u003c/td\u003e\n \u003ctd\u003e4\u003c/td\u003e\n \u003ctd\u003e10.0\u003c/td\u003e\n \u003ctd\u003e6.0\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003emalignant\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eTrue\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003c/tr\u003e\n \u003c/tbody\u003e\n\u003c/table\u003e\n\u003cp\u003e637 rows × 15 columns\u003c/p\u003e\n\u003c/div\u003e\n\n```python\ncombined_doctors_hotEncoded_df.isnull().values.any()\ncombined_doctors_hotEncoded_df.isnull().sum().sum()\n```\n\n 0\n\n## 6.2 `class` column.\n\n```python\n# How to convert benign \u0026 malingant to 0 and 1\nchange_class_numeric = {'benign':0, 'malignant':1}\ncombined_doctors_hotEncoded_df['class'] = combined_doctors_hotEncoded_df['class'].map(change_class_numeric)\n```\n\n```python\ncombined_doctors_hotEncoded_df\n```\n\n\u003cdiv\u003e\n\u003cstyle scoped\u003e\n .dataframe tbody tr th:only-of-type {\n vertical-align: middle;\n }\n .dataframe tbody tr th {\n vertical-align: top;\n }\n .dataframe thead th {\n text-align: right;\n }\n\u003c/style\u003e\n\u003ctable border=\"1\" class=\"dataframe\"\u003e\n \u003cthead\u003e\n \u003ctr style=\"text-align: right;\"\u003e\n \u003cth\u003e\u003c/th\u003e\n \u003cth\u003epatient_id\u003c/th\u003e\n \u003cth\u003eclump_thickness\u003c/th\u003e\n \u003cth\u003ecell_size_uniformity\u003c/th\u003e\n \u003cth\u003ecell_shape_uniformity\u003c/th\u003e\n \u003cth\u003emarginal_adhesion\u003c/th\u003e\n \u003cth\u003esingle_ep_cell_size\u003c/th\u003e\n \u003cth\u003ebare_nuclei\u003c/th\u003e\n \u003cth\u003ebland_chromatin\u003c/th\u003e\n \u003cth\u003enormal_nucleoli\u003c/th\u003e\n \u003cth\u003emitoses\u003c/th\u003e\n \u003cth\u003eclass\u003c/th\u003e\n \u003cth\u003eDr. Doe\u003c/th\u003e\n \u003cth\u003eDr. Lee\u003c/th\u003e\n \u003cth\u003eDr. Smith\u003c/th\u003e\n \u003cth\u003eDr. Wong\u003c/th\u003e\n \u003c/tr\u003e\n \u003c/thead\u003e\n \u003ctbody\u003e\n \u003ctr\u003e\n \u003cth\u003e0\u003c/th\u003e\n \u003ctd\u003e1000025\u003c/td\u003e\n \u003ctd\u003e5.0\u003c/td\u003e\n \u003ctd\u003e1.0\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003e2\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003e3.0\u003c/td\u003e\n \u003ctd\u003e1.0\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003e0\u003c/td\u003e\n \u003ctd\u003eTrue\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003c/tr\u003e\n \u003ctr\u003e\n \u003cth\u003e1\u003c/th\u003e\n \u003ctd\u003e1002945\u003c/td\u003e\n \u003ctd\u003e5.0\u003c/td\u003e\n \u003ctd\u003e4.0\u003c/td\u003e\n \u003ctd\u003e4\u003c/td\u003e\n \u003ctd\u003e5\u003c/td\u003e\n \u003ctd\u003e7\u003c/td\u003e\n \u003ctd\u003e10\u003c/td\u003e\n \u003ctd\u003e3.0\u003c/td\u003e\n \u003ctd\u003e2.0\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003e0\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eTrue\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003c/tr\u003e\n \u003ctr\u003e\n \u003cth\u003e2\u003c/th\u003e\n \u003ctd\u003e1015425\u003c/td\u003e\n \u003ctd\u003e3.0\u003c/td\u003e\n \u003ctd\u003e1.0\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003e2\u003c/td\u003e\n \u003ctd\u003e2\u003c/td\u003e\n \u003ctd\u003e3.0\u003c/td\u003e\n \u003ctd\u003e1.0\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003e0\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eTrue\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003c/tr\u003e\n \u003ctr\u003e\n \u003cth\u003e3\u003c/th\u003e\n \u003ctd\u003e1016277\u003c/td\u003e\n \u003ctd\u003e6.0\u003c/td\u003e\n \u003ctd\u003e8.0\u003c/td\u003e\n \u003ctd\u003e8\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003e3\u003c/td\u003e\n \u003ctd\u003e4\u003c/td\u003e\n \u003ctd\u003e3.0\u003c/td\u003e\n \u003ctd\u003e7.0\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003e0\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eTrue\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003c/tr\u003e\n \u003ctr\u003e\n \u003cth\u003e4\u003c/th\u003e\n \u003ctd\u003e1017023\u003c/td\u003e\n \u003ctd\u003e4.0\u003c/td\u003e\n \u003ctd\u003e1.0\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003e3\u003c/td\u003e\n \u003ctd\u003e2\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003e3.0\u003c/td\u003e\n \u003ctd\u003e1.0\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003e0\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eTrue\u003c/td\u003e\n \u003c/tr\u003e\n \u003ctr\u003e\n \u003cth\u003e...\u003c/th\u003e\n \u003ctd\u003e...\u003c/td\u003e\n \u003ctd\u003e...\u003c/td\u003e\n \u003ctd\u003e...\u003c/td\u003e\n \u003ctd\u003e...\u003c/td\u003e\n \u003ctd\u003e...\u003c/td\u003e\n \u003ctd\u003e...\u003c/td\u003e\n \u003ctd\u003e...\u003c/td\u003e\n \u003ctd\u003e...\u003c/td\u003e\n \u003ctd\u003e...\u003c/td\u003e\n \u003ctd\u003e...\u003c/td\u003e\n \u003ctd\u003e...\u003c/td\u003e\n \u003ctd\u003e...\u003c/td\u003e\n \u003ctd\u003e...\u003c/td\u003e\n \u003ctd\u003e...\u003c/td\u003e\n \u003ctd\u003e...\u003c/td\u003e\n \u003c/tr\u003e\n \u003ctr\u003e\n \u003cth\u003e693\u003c/th\u003e\n \u003ctd\u003e763235\u003c/td\u003e\n \u003ctd\u003e3.0\u003c/td\u003e\n \u003ctd\u003e1.0\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003e2\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003e2.0\u003c/td\u003e\n \u003ctd\u003e1.0\u003c/td\u003e\n \u003ctd\u003e2\u003c/td\u003e\n \u003ctd\u003e0\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eTrue\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003c/tr\u003e\n \u003ctr\u003e\n \u003cth\u003e694\u003c/th\u003e\n \u003ctd\u003e776715\u003c/td\u003e\n \u003ctd\u003e3.0\u003c/td\u003e\n \u003ctd\u003e1.0\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003e3\u003c/td\u003e\n \u003ctd\u003e2\u003c/td\u003e\n \u003ctd\u003e1.0\u003c/td\u003e\n \u003ctd\u003e1.0\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003e0\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eTrue\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003c/tr\u003e\n \u003ctr\u003e\n \u003cth\u003e695\u003c/th\u003e\n \u003ctd\u003e841769\u003c/td\u003e\n \u003ctd\u003e2.0\u003c/td\u003e\n \u003ctd\u003e1.0\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003e2\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003e1.0\u003c/td\u003e\n \u003ctd\u003e1.0\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003e0\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eTrue\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003c/tr\u003e\n \u003ctr\u003e\n \u003cth\u003e696\u003c/th\u003e\n \u003ctd\u003e888820\u003c/td\u003e\n \u003ctd\u003e5.0\u003c/td\u003e\n \u003ctd\u003e10.0\u003c/td\u003e\n \u003ctd\u003e10\u003c/td\u003e\n \u003ctd\u003e3\u003c/td\u003e\n \u003ctd\u003e7\u003c/td\u003e\n \u003ctd\u003e3\u003c/td\u003e\n \u003ctd\u003e8.0\u003c/td\u003e\n \u003ctd\u003e10.0\u003c/td\u003e\n \u003ctd\u003e2\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eTrue\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003c/tr\u003e\n \u003ctr\u003e\n \u003cth\u003e697\u003c/th\u003e\n \u003ctd\u003e897471\u003c/td\u003e\n \u003ctd\u003e4.0\u003c/td\u003e\n \u003ctd\u003e8.0\u003c/td\u003e\n \u003ctd\u003e6\u003c/td\u003e\n \u003ctd\u003e4\u003c/td\u003e\n \u003ctd\u003e3\u003c/td\u003e\n \u003ctd\u003e4\u003c/td\u003e\n \u003ctd\u003e10.0\u003c/td\u003e\n \u003ctd\u003e6.0\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eTrue\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003c/tr\u003e\n \u003c/tbody\u003e\n\u003c/table\u003e\n\u003cp\u003e637 rows × 15 columns\u003c/p\u003e\n\u003c/div\u003e\n\n```python\n#Making a new column based on a nuemrical calcualtion of other columns in the df\ncombined_doctors_hotEncoded_df['new_column'] = df.normal_nucleoli * df.mitoses\n```\n\n```python\ncombined_doctors_hotEncoded_df.head()\n```\n\n\u003cdiv\u003e\n\u003cstyle scoped\u003e\n .dataframe tbody tr th:only-of-type {\n vertical-align: middle;\n }\n .dataframe tbody tr th {\n vertical-align: top;\n }\n .dataframe thead th {\n text-align: right;\n }\n\u003c/style\u003e\n\u003ctable border=\"1\" class=\"dataframe\"\u003e\n \u003cthead\u003e\n \u003ctr style=\"text-align: right;\"\u003e\n \u003cth\u003e\u003c/th\u003e\n \u003cth\u003epatient_id\u003c/th\u003e\n \u003cth\u003eclump_thickness\u003c/th\u003e\n \u003cth\u003ecell_size_uniformity\u003c/th\u003e\n \u003cth\u003ecell_shape_uniformity\u003c/th\u003e\n \u003cth\u003emarginal_adhesion\u003c/th\u003e\n \u003cth\u003esingle_ep_cell_size\u003c/th\u003e\n \u003cth\u003ebare_nuclei\u003c/th\u003e\n \u003cth\u003ebland_chromatin\u003c/th\u003e\n \u003cth\u003enormal_nucleoli\u003c/th\u003e\n \u003cth\u003emitoses\u003c/th\u003e\n \u003cth\u003eclass\u003c/th\u003e\n \u003cth\u003eDr. Doe\u003c/th\u003e\n \u003cth\u003eDr. Lee\u003c/th\u003e\n \u003cth\u003eDr. Smith\u003c/th\u003e\n \u003cth\u003eDr. Wong\u003c/th\u003e\n \u003cth\u003enew_column\u003c/th\u003e\n \u003c/tr\u003e\n \u003c/thead\u003e\n \u003ctbody\u003e\n \u003ctr\u003e\n \u003cth\u003e0\u003c/th\u003e\n \u003ctd\u003e1000025\u003c/td\u003e\n \u003ctd\u003e5.0\u003c/td\u003e\n \u003ctd\u003e1.0\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003e2\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003e3.0\u003c/td\u003e\n \u003ctd\u003e1.0\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003e0\u003c/td\u003e\n \u003ctd\u003eTrue\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003e1.0\u003c/td\u003e\n \u003c/tr\u003e\n \u003ctr\u003e\n \u003cth\u003e1\u003c/th\u003e\n \u003ctd\u003e1002945\u003c/td\u003e\n \u003ctd\u003e5.0\u003c/td\u003e\n \u003ctd\u003e4.0\u003c/td\u003e\n \u003ctd\u003e4\u003c/td\u003e\n \u003ctd\u003e5\u003c/td\u003e\n \u003ctd\u003e7\u003c/td\u003e\n \u003ctd\u003e10\u003c/td\u003e\n \u003ctd\u003e3.0\u003c/td\u003e\n \u003ctd\u003e2.0\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003e0\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eTrue\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003e2.0\u003c/td\u003e\n \u003c/tr\u003e\n \u003ctr\u003e\n \u003cth\u003e2\u003c/th\u003e\n \u003ctd\u003e1015425\u003c/td\u003e\n \u003ctd\u003e3.0\u003c/td\u003e\n \u003ctd\u003e1.0\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003e2\u003c/td\u003e\n \u003ctd\u003e2\u003c/td\u003e\n \u003ctd\u003e3.0\u003c/td\u003e\n \u003ctd\u003e1.0\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003e0\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eTrue\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003e1.0\u003c/td\u003e\n \u003c/tr\u003e\n \u003ctr\u003e\n \u003cth\u003e3\u003c/th\u003e\n \u003ctd\u003e1016277\u003c/td\u003e\n \u003ctd\u003e6.0\u003c/td\u003e\n \u003ctd\u003e8.0\u003c/td\u003e\n \u003ctd\u003e8\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003e3\u003c/td\u003e\n \u003ctd\u003e4\u003c/td\u003e\n \u003ctd\u003e3.0\u003c/td\u003e\n \u003ctd\u003e7.0\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003e0\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eTrue\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003e7.0\u003c/td\u003e\n \u003c/tr\u003e\n \u003ctr\u003e\n \u003cth\u003e4\u003c/th\u003e\n \u003ctd\u003e1017023\u003c/td\u003e\n \u003ctd\u003e4.0\u003c/td\u003e\n \u003ctd\u003e1.0\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003e3\u003c/td\u003e\n \u003ctd\u003e2\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003e3.0\u003c/td\u003e\n \u003ctd\u003e1.0\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003e0\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eTrue\u003c/td\u003e\n \u003ctd\u003e1.0\u003c/td\u003e\n \u003c/tr\u003e\n \u003c/tbody\u003e\n\u003c/table\u003e\n\u003c/div\u003e\n\n```python\ncombined_doctors_hotEncoded_df.isnull().values.any()\ncombined_doctors_hotEncoded_df.isnull().sum().sum()\n```\n\n 0\n\n# 7. Feature Generation\n\nThis is among the crucial aspect area of `Machine Learning` model in the article, as this article [point out](https://towardsdatascience.com/data-wrangling-with-pandas-5b0be151df4e) an individual might be classified as having a cancer if meet the following condtion:\n\n- Their `cell_size_uniformity` is greater than 5, and\n- Their `cell_shape_uniformity` is greater than 5.\n\nBased on this information, we could create another Feature from them.\n\n```python\n# Feature building:\ndef celltypelabel(x):\n if ((x['cell_size_uniformity'] \u003e 5) \u0026 (x['cell_shape_uniformity'] \u003e 5)):\n return('1')\n else:\n return('0')\n```\n\nThe code provided defines a function `celltypelabel` that takes a dictionary `x` as input and returns a string value based on the values of two specific keys within that dictionary: `'cell_size_uniformity'` and `'cell_shape_uniformity'`.\n\nHere’s a step-by-step explanation of the function:\n\n1. **Function Definition**:\n\n ````python\n def celltypelabel(x):\n ```\n This defines a function named `celltypelabel` that takes one argument, `x`.\n\n ````\n\n2. **Conditional Statement**:\n\n ````python\n if ((x['cell_size_uniformity'] \u003e 5) \u0026 (x['cell_shape_uniformity'] \u003e 5)):\n ```\n This is a conditional statement that checks two conditions:\n - The value of `'cell_size_uniformity'` in the dictionary `x` must be greater than 5.\n - The value of `'cell_shape_uniformity'` in the dictionary `x` must also be greater than 5.\n\n ````\n\n3. **Logical AND Operator (`\u0026`)**:\n The logical AND operator (`\u0026`) is used to combine these two conditions. Both conditions must be true for this part of the if-statement to evaluate to True.\n\n4. **Return Statement**:\n\n ```python\n return('1')\n ```\n\n If both conditions are met (i.e., both `'cell_size_uniformity'` and `'cell_shape_uniformity'` are greater than 5), the function returns the string `'1'`.\n\n5. **Else Clause**:\n ```python\n else:\n return('0')\n ```\n If either or both conditions are not met (i.e., either `'cell_size_uniformity'` or `'cell_shape_uniformity'` is not greater than 5), the function returns the string `'0'`.\n\nThen we use the pandas apply function to run the `celltypelabel(x)` function on the dataframe.\n\n```python\ncombined_doctors_hotEncoded_df['cell_type_label'] = combined_doctors_hotEncoded_df.apply(lambda x: celltypelabel(x), axis=1)\n```\n\nThe code snippet provided is used to apply the `celltypelabel` function to each row of the `combined_doctors_hotEncoded_df` DataFrame. Here’s a breakdown of what this code does:\n\n```python\ncombined_doctors_hotEncoded_df['cell_type_label'] = combined_doctors_hotEncoded_df.apply(lambda x: celltypelabel(x), axis=1)\n```\n\n### 7.1 Explanation:\n\n1. **Apply Method**: The `.apply()` method is used to apply a function to each row or column of a DataFrame.\n2. **Lambda Function**: A lambda function is used to define the function to be applied. In this case, it calls the `celltypelabel` function.\n3. **Axis=1**: The `axis=1` parameter specifies that the function should be applied to each row (as opposed to each column, which would be `axis=0`).\n\n### 7.2 Step-by-Step Breakdown:\n\n1. **Define the Lambda Function**:\n\n ```python\n lambda x: celltypelabel(x)\n ```\n\n This defines a lambda function that takes a dictionary `x` and calls the `celltypelabel` function.\n\n2. **Apply the Lambda Function to Each Row**:\n\n ```python\n combined_doctors_hotEncoded_df.apply(lambda x: celltypelabel(x), axis=1)\n ```\n\n This applies the lambda function to each row of the DataFrame. The result of this application is a new Series where each element is the output of the `celltypelabel` function for that corresponding row.\n\n3. **Assign Result to New Column**:\n ```python\n combined_doctors_hotEncoded_df['cell_type_label'] = ...\n ```\n The result of applying the lambda function is assigned to a new column named `'cell_type_label'` in the DataFrame.\n\n```python\ncombined_doctors_hotEncoded_df[['patient_id', 'cell_type_label']]\n```\n\n\u003cdiv\u003e\n\u003cstyle scoped\u003e\n .dataframe tbody tr th:only-of-type {\n vertical-align: middle;\n }\n .dataframe tbody tr th {\n vertical-align: top;\n }\n .dataframe thead th {\n text-align: right;\n }\n\u003c/style\u003e\n\u003ctable border=\"1\" class=\"dataframe\"\u003e\n \u003cthead\u003e\n \u003ctr style=\"text-align: right;\"\u003e\n \u003cth\u003e\u003c/th\u003e\n \u003cth\u003epatient_id\u003c/th\u003e\n \u003cth\u003ecell_type_label\u003c/th\u003e\n \u003c/tr\u003e\n \u003c/thead\u003e\n \u003ctbody\u003e\n \u003ctr\u003e\n \u003cth\u003e0\u003c/th\u003e\n \u003ctd\u003e1000025\u003c/td\u003e\n \u003ctd\u003e0\u003c/td\u003e\n \u003c/tr\u003e\n \u003ctr\u003e\n \u003cth\u003e1\u003c/th\u003e\n \u003ctd\u003e1002945\u003c/td\u003e\n \u003ctd\u003e0\u003c/td\u003e\n \u003c/tr\u003e\n \u003ctr\u003e\n \u003cth\u003e2\u003c/th\u003e\n \u003ctd\u003e1015425\u003c/td\u003e\n \u003ctd\u003e0\u003c/td\u003e\n \u003c/tr\u003e\n \u003ctr\u003e\n \u003cth\u003e3\u003c/th\u003e\n \u003ctd\u003e1016277\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003c/tr\u003e\n \u003ctr\u003e\n \u003cth\u003e4\u003c/th\u003e\n \u003ctd\u003e1017023\u003c/td\u003e\n \u003ctd\u003e0\u003c/td\u003e\n \u003c/tr\u003e\n \u003ctr\u003e\n \u003cth\u003e...\u003c/th\u003e\n \u003ctd\u003e...\u003c/td\u003e\n \u003ctd\u003e...\u003c/td\u003e\n \u003c/tr\u003e\n \u003ctr\u003e\n \u003cth\u003e693\u003c/th\u003e\n \u003ctd\u003e763235\u003c/td\u003e\n \u003ctd\u003e0\u003c/td\u003e\n \u003c/tr\u003e\n \u003ctr\u003e\n \u003cth\u003e694\u003c/th\u003e\n \u003ctd\u003e776715\u003c/td\u003e\n \u003ctd\u003e0\u003c/td\u003e\n \u003c/tr\u003e\n \u003ctr\u003e\n \u003cth\u003e695\u003c/th\u003e\n \u003ctd\u003e841769\u003c/td\u003e\n \u003ctd\u003e0\u003c/td\u003e\n \u003c/tr\u003e\n \u003ctr\u003e\n \u003cth\u003e696\u003c/th\u003e\n \u003ctd\u003e888820\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003c/tr\u003e\n \u003ctr\u003e\n \u003cth\u003e697\u003c/th\u003e\n \u003ctd\u003e897471\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003c/tr\u003e\n \u003c/tbody\u003e\n\u003c/table\u003e\n\u003cp\u003e637 rows × 2 columns\u003c/p\u003e\n\u003c/div\u003e\n\n```python\ncombined_doctors_hotEncoded_df\n```\n\n\u003cdiv\u003e\n\u003cstyle scoped\u003e\n .dataframe tbody tr th:only-of-type {\n vertical-align: middle;\n }\n .dataframe tbody tr th {\n vertical-align: top;\n }\n .dataframe thead th {\n text-align: right;\n }\n\u003c/style\u003e\n\u003ctable border=\"1\" class=\"dataframe\"\u003e\n \u003cthead\u003e\n \u003ctr style=\"text-align: right;\"\u003e\n \u003cth\u003e\u003c/th\u003e\n \u003cth\u003epatient_id\u003c/th\u003e\n \u003cth\u003eclump_thickness\u003c/th\u003e\n \u003cth\u003ecell_size_uniformity\u003c/th\u003e\n \u003cth\u003ecell_shape_uniformity\u003c/th\u003e\n \u003cth\u003emarginal_adhesion\u003c/th\u003e\n \u003cth\u003esingle_ep_cell_size\u003c/th\u003e\n \u003cth\u003ebare_nuclei\u003c/th\u003e\n \u003cth\u003ebland_chromatin\u003c/th\u003e\n \u003cth\u003enormal_nucleoli\u003c/th\u003e\n \u003cth\u003emitoses\u003c/th\u003e\n \u003cth\u003eclass\u003c/th\u003e\n \u003cth\u003eDr. Doe\u003c/th\u003e\n \u003cth\u003eDr. Lee\u003c/th\u003e\n \u003cth\u003eDr. Smith\u003c/th\u003e\n \u003cth\u003eDr. Wong\u003c/th\u003e\n \u003cth\u003enew_column\u003c/th\u003e\n \u003cth\u003ecell_type_label\u003c/th\u003e\n \u003c/tr\u003e\n \u003c/thead\u003e\n \u003ctbody\u003e\n \u003ctr\u003e\n \u003cth\u003e0\u003c/th\u003e\n \u003ctd\u003e1000025\u003c/td\u003e\n \u003ctd\u003e5.0\u003c/td\u003e\n \u003ctd\u003e1.0\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003e2\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003e3.0\u003c/td\u003e\n \u003ctd\u003e1.0\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003e0\u003c/td\u003e\n \u003ctd\u003eTrue\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003e1.0\u003c/td\u003e\n \u003ctd\u003e0\u003c/td\u003e\n \u003c/tr\u003e\n \u003ctr\u003e\n \u003cth\u003e1\u003c/th\u003e\n \u003ctd\u003e1002945\u003c/td\u003e\n \u003ctd\u003e5.0\u003c/td\u003e\n \u003ctd\u003e4.0\u003c/td\u003e\n \u003ctd\u003e4\u003c/td\u003e\n \u003ctd\u003e5\u003c/td\u003e\n \u003ctd\u003e7\u003c/td\u003e\n \u003ctd\u003e10\u003c/td\u003e\n \u003ctd\u003e3.0\u003c/td\u003e\n \u003ctd\u003e2.0\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003e0\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eTrue\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003e2.0\u003c/td\u003e\n \u003ctd\u003e0\u003c/td\u003e\n \u003c/tr\u003e\n \u003ctr\u003e\n \u003cth\u003e2\u003c/th\u003e\n \u003ctd\u003e1015425\u003c/td\u003e\n \u003ctd\u003e3.0\u003c/td\u003e\n \u003ctd\u003e1.0\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003e2\u003c/td\u003e\n \u003ctd\u003e2\u003c/td\u003e\n \u003ctd\u003e3.0\u003c/td\u003e\n \u003ctd\u003e1.0\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003e0\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eTrue\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003e1.0\u003c/td\u003e\n \u003ctd\u003e0\u003c/td\u003e\n \u003c/tr\u003e\n \u003ctr\u003e\n \u003cth\u003e3\u003c/th\u003e\n \u003ctd\u003e1016277\u003c/td\u003e\n \u003ctd\u003e6.0\u003c/td\u003e\n \u003ctd\u003e8.0\u003c/td\u003e\n \u003ctd\u003e8\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003e3\u003c/td\u003e\n \u003ctd\u003e4\u003c/td\u003e\n \u003ctd\u003e3.0\u003c/td\u003e\n \u003ctd\u003e7.0\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003e0\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eTrue\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003e7.0\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003c/tr\u003e\n \u003ctr\u003e\n \u003cth\u003e4\u003c/th\u003e\n \u003ctd\u003e1017023\u003c/td\u003e\n \u003ctd\u003e4.0\u003c/td\u003e\n \u003ctd\u003e1.0\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003e3\u003c/td\u003e\n \u003ctd\u003e2\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003e3.0\u003c/td\u003e\n \u003ctd\u003e1.0\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003e0\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eTrue\u003c/td\u003e\n \u003ctd\u003e1.0\u003c/td\u003e\n \u003ctd\u003e0\u003c/td\u003e\n \u003c/tr\u003e\n \u003ctr\u003e\n \u003cth\u003e...\u003c/th\u003e\n \u003ctd\u003e...\u003c/td\u003e\n \u003ctd\u003e...\u003c/td\u003e\n \u003ctd\u003e...\u003c/td\u003e\n \u003ctd\u003e...\u003c/td\u003e\n \u003ctd\u003e...\u003c/td\u003e\n \u003ctd\u003e...\u003c/td\u003e\n \u003ctd\u003e...\u003c/td\u003e\n \u003ctd\u003e...\u003c/td\u003e\n \u003ctd\u003e...\u003c/td\u003e\n \u003ctd\u003e...\u003c/td\u003e\n \u003ctd\u003e...\u003c/td\u003e\n \u003ctd\u003e...\u003c/td\u003e\n \u003ctd\u003e...\u003c/td\u003e\n \u003ctd\u003e...\u003c/td\u003e\n \u003ctd\u003e...\u003c/td\u003e\n \u003ctd\u003e...\u003c/td\u003e\n \u003ctd\u003e...\u003c/td\u003e\n \u003c/tr\u003e\n \u003ctr\u003e\n \u003cth\u003e693\u003c/th\u003e\n \u003ctd\u003e763235\u003c/td\u003e\n \u003ctd\u003e3.0\u003c/td\u003e\n \u003ctd\u003e1.0\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003e2\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003e2.0\u003c/td\u003e\n \u003ctd\u003e1.0\u003c/td\u003e\n \u003ctd\u003e2\u003c/td\u003e\n \u003ctd\u003e0\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eTrue\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003e2.0\u003c/td\u003e\n \u003ctd\u003e0\u003c/td\u003e\n \u003c/tr\u003e\n \u003ctr\u003e\n \u003cth\u003e694\u003c/th\u003e\n \u003ctd\u003e776715\u003c/td\u003e\n \u003ctd\u003e3.0\u003c/td\u003e\n \u003ctd\u003e1.0\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003e3\u003c/td\u003e\n \u003ctd\u003e2\u003c/td\u003e\n \u003ctd\u003e1.0\u003c/td\u003e\n \u003ctd\u003e1.0\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003e0\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eTrue\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003e1.0\u003c/td\u003e\n \u003ctd\u003e0\u003c/td\u003e\n \u003c/tr\u003e\n \u003ctr\u003e\n \u003cth\u003e695\u003c/th\u003e\n \u003ctd\u003e841769\u003c/td\u003e\n \u003ctd\u003e2.0\u003c/td\u003e\n \u003ctd\u003e1.0\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003e2\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003e1.0\u003c/td\u003e\n \u003ctd\u003e1.0\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003e0\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eTrue\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003e1.0\u003c/td\u003e\n \u003ctd\u003e0\u003c/td\u003e\n \u003c/tr\u003e\n \u003ctr\u003e\n \u003cth\u003e696\u003c/th\u003e\n \u003ctd\u003e888820\u003c/td\u003e\n \u003ctd\u003e5.0\u003c/td\u003e\n \u003ctd\u003e10.0\u003c/td\u003e\n \u003ctd\u003e10\u003c/td\u003e\n \u003ctd\u003e3\u003c/td\u003e\n \u003ctd\u003e7\u003c/td\u003e\n \u003ctd\u003e3\u003c/td\u003e\n \u003ctd\u003e8.0\u003c/td\u003e\n \u003ctd\u003e10.0\u003c/td\u003e\n \u003ctd\u003e2\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eTrue\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003e20.0\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003c/tr\u003e\n \u003ctr\u003e\n \u003cth\u003e697\u003c/th\u003e\n \u003ctd\u003e897471\u003c/td\u003e\n \u003ctd\u003e4.0\u003c/td\u003e\n \u003ctd\u003e8.0\u003c/td\u003e\n \u003ctd\u003e6\u003c/td\u003e\n \u003ctd\u003e4\u003c/td\u003e\n \u003ctd\u003e3\u003c/td\u003e\n \u003ctd\u003e4\u003c/td\u003e\n \u003ctd\u003e10.0\u003c/td\u003e\n \u003ctd\u003e6.0\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eTrue\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003eFalse\u003c/td\u003e\n \u003ctd\u003e6.0\u003c/td\u003e\n \u003ctd\u003e1\u003c/td\u003e\n \u003c/tr\u003e\n \u003c/tbody\u003e\n\u003c/table\u003e\n\u003cp\u003e637 rows × 17 columns\u003c/p\u003e\n\u003c/div\u003e\n\n```python\ncombined_doctors_hotEncoded_df.isnull().values.any()\ncombined_doctors_hotEncoded_df.isnull().sum().sum()\n```\n\n 0\n\n```python\ncombined_doctors_hotEncoded_df.describe()\n```\n\n\u003cdiv\u003e\n\u003cstyle scoped\u003e\n .dataframe tbody tr th:only-of-type {\n vertical-align: middle;\n }\n .dataframe tbody tr th {\n vertical-align: top;\n }\n .dataframe thead th {\n text-align: right;\n }\n\u003c/style\u003e\n\u003ctable border=\"1\" class=\"dataframe\"\u003e\n \u003cthead\u003e\n \u003ctr style=\"text-align: right;\"\u003e\n \u003cth\u003e\u003c/th\u003e\n \u003cth\u003epatient_id\u003c/th\u003e\n \u003cth\u003eclump_thickness\u003c/th\u003e\n \u003cth\u003ecell_size_uniformity\u003c/th\u003e\n \u003cth\u003ecell_shape_uniformity\u003c/th\u003e\n \u003cth\u003emarginal_adhesion\u003c/th\u003e\n \u003cth\u003esingle_ep_cell_size\u003c/th\u003e\n \u003cth\u003ebland_chromatin\u003c/th\u003e\n \u003cth\u003enormal_nucleoli\u003c/th\u003e\n \u003cth\u003emitoses\u003c/th\u003e\n \u003cth\u003eclass\u003c/th\u003e\n \u003cth\u003enew_column\u003c/th\u003e\n \u003c/tr\u003e\n \u003c/thead\u003e\n \u003ctbody\u003e\n \u003ctr\u003e\n \u003cth\u003ecount\u003c/th\u003e\n \u003ctd\u003e6.370000e+02\u003c/td\u003e\n \u003ctd\u003e637.000000\u003c/td\u003e\n \u003ctd\u003e637.000000\u003c/td\u003e\n \u003ctd\u003e637.000000\u003c/td\u003e\n \u003ctd\u003e637.000000\u003c/td\u003e\n \u003ctd\u003e637.000000\u003c/td\u003e\n \u003ctd\u003e637.000000\u003c/td\u003e\n \u003ctd\u003e637.000000\u003c/td\u003e\n \u003ctd\u003e637.000000\u003c/td\u003e\n \u003ctd\u003e637.000000\u003c/td\u003e\n \u003ctd\u003e637.000000\u003c/td\u003e\n \u003c/tr\u003e\n \u003ctr\u003e\n \u003cth\u003emean\u003c/th\u003e\n \u003ctd\u003e1.076689e+06\u003c/td\u003e\n \u003ctd\u003e4.488226\u003c/td\u003e\n \u003ctd\u003e3.210361\u003c/td\u003e\n \u003ctd\u003e3.298273\u003c/td\u003e\n \u003ctd\u003e2.897959\u003c/td\u003e\n \u003ctd\u003e3.284144\u003c/td\u003e\n \u003ctd\u003e3.516484\u003c/td\u003e\n \u003ctd\u003e2.971743\u003c/td\u003e\n \u003ctd\u003e1.629513\u003c/td\u003e\n \u003ctd\u003e0.361068\u003c/td\u003e\n \u003ctd\u003e7.197802\u003c/td\u003e\n \u003c/tr\u003e\n \u003ctr\u003e\n \u003cth\u003estd\u003c/th\u003e\n \u003ctd\u003e6.408652e+05\u003c/td\u003e\n \u003ctd\u003e2.855856\u003c/td\u003e\n \u003ctd\u003e3.080628\u003c/td\u003e\n \u003ctd\u003e3.0","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fleonism%2Fbreast-cancer","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fleonism%2Fbreast-cancer","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fleonism%2Fbreast-cancer/lists"}