Confusion matrix for Binary classification in Machine Learning
A confusion matrix is a technique for summarizing the performance of a classification algorithm. It is represented in an N x N matrix form where N is the number of target or output classes. Let’s say we have gender classification…
Install MongoDB in Local environment without admin privileges
Installing MongoDB with windows msi installer needs administrator rights. Alternatively you can install the community edition on your local account without admin privileges. Follow the below steps to setup the mongo db server on your local account Download the ‘MongoDB…
Making HTTP Requests and processing JSON Response in python
We can make HTTP GET requests with python libraries like urllib , httplib and request.In the below example we will make an API call with requests library and processthe JSON data returned from server. Here we are fetching the current…
Parsing Web Pages with Python
Scraping and parsing text from websites can be done with urlopen request method .Python libraray urllib contains tools for working with URLs. You can fetch all the html code by providing the urllink . Once all the html text is…
bazaar command giving except locale.Error , e
Sometimes bazaar throws below error whenever there is change in python version.This happens since the exception handling between two python versions has changed or different. So you need to use the correct version to resolve the issue.So you need to…
Install git in non root user account
To Install and build git from source in a non-root user account download the source tarball from kernel.org .For the current example i have used git-2.29.2.tar.gz on RHEL 8 version. Login as a non root user and follow the below…
Set Windows Environment Variables without admin rights
In windows thee are two sets of environment variables; one for the current user, and one for the whole users and the current machine ( system-wide). First option can be used to set path variable permanently for normal user not…
Install bazaar with local user and non root privilege
If you check bzr INSTALL file for installation instructions you will find there are two modes in whichbazaar installation can be done. 1. To install bzr as a user, run ( non root) 2. To install system-wide, run (as root)…
Move or Migrate wordpress site from Server to Localhost
There are many plugins available to migrate wordPress sites ,but you can do it manually.This article explains how to to migrate or move your live WordPress site to local server. Follow the below steps for moving data from server to…
SPARK REDUCE VS REDUCEBYKEY
Spark RDD reduce aggregate function is used to aggregate the dataset i.e. calculate min, max of elements in a dataset. SYNTAX: def reduce(f: (T, T) => T): T The argument is a Commutative and Associative function The parameter function should…
Spark write or save dataframes examples
Dataframes in spark can be saved into different file formats with DataframeWriter’s write API.Spark supports text,parquet,orc,json file formats. By default it saves in parquet file format. You can provide different compression options during saving the output . With mode you…
Saving Spark Dataframes to different file formats
DataFrameWriter API can be used to save Spark dataframes to different file formats and external sources. The common syntax usage is as below. The default write mode is PARQUET file and files are saved to hdfs . The mode can…
Connect Oracle with Spark
Reading data from oracle database with Spark can be done with these steps. Get The JDBC Thin Driver Download the proper driver ojdbc6.jar for Oracle11.2 and ojdbc7.jar for Oracle12c. Check the compatibility…