Install MongoDB in Local environment without admin privileges

Installing MongoDB with windows msi installer needs administrator rights. Alternatively you can install the community edition on your local account without admin privileges. Follow the below steps to setup the mongo db server on your local account Download the ‘MongoDB…

Parsing Web Pages with Python

Scraping and parsing text from websites can be done with urlopen request method .Python libraray urllib contains tools for working with URLs. You can fetch all the html code by providing the urllink . Once all the html text is…

bazaar command giving except locale.Error , e

Sometimes bazaar throws below error whenever there is change in python version.This happens since the exception handling between two python versions has changed or different. So you need to use the correct version to resolve the issue.So you need to…

Install git in non root user account

To Install and build git from source in a non-root user account download the source tarball from kernel.org .For the current example i have used git-2.29.2.tar.gz on RHEL 8 version. Login as a non root user and follow the below…

SPARK REDUCE VS REDUCEBYKEY

Spark RDD reduce aggregate function is used to aggregate the dataset i.e. calculate min, max of elements in a dataset. SYNTAX: def reduce(f: (T, T) => T): T The argument is a Commutative and Associative function The parameter function should…

Spark write or save dataframes examples

Dataframes in spark can be saved into different file formats with DataframeWriter’s write API.Spark supports text,parquet,orc,json file formats. By default it saves in parquet file format. You can provide different compression options during saving the output . With mode you…

Connect Oracle with Spark

Reading data from oracle database with Spark can be done with these steps.  Get The JDBC Thin Driver           Download the proper driver ojdbc6.jar for Oracle11.2 and ojdbc7.jar for Oracle12c.           Check the compatibility…