fgrep files

Learn how to use fgrep to compare the contents of two files with each other. The command can be used to find the contents present in one file but not in the other file. This does not require the file contents to be sorted. Find contents of file1 that are also present in file2 fgrep … Read more

Create MySQL user on AWS RDS server

This post explains how to create a user account on AWS RDS servers and assign privileges to access tables. I did this on Maria DB server and I assume this process would work for Aurora DB instances too. First you need to logon to the DB. You can use mysql utility for this. mysql -h … Read more

Replace URL paths with Search Regex plugin

Website changes are very common in bloggers’ world – Migrating from blogger platform to WordPress, changing permalink structure and moving content to a new domain. I did all of these which resulted in the below issues. URL links in posts that are with old permalink structure. They are like mydomain.com/2013/05/some-post.html. URL links pointing to old … Read more

Configure fingerprint login Dell laptop

My new laptop Dell Latitude E7450 has Broadcom fingerprint scanner. The OS image that I received with the laptop did not have the updated drivers installed for this device and I had trouble in configuring finger print based login. When I opened bio-metric device settings in control panel, it was showing unavailable status as below. … Read more

SparkException File ./myapplication.jar exists and does not match contents of

I got this exception when I was running an EMR application org.apache.spark.SparkException: File ./myapplication.jar exists and does not match contents of //10.28.139.44:33084/jars/myapplication.jar If you run into this exception, the issue could be that the nodes have run out of disk space on one of the partitions as I found it out in my case. When … Read more

Hadoop file system commands

If you are working with EMR or hadoop, the following file system command would be handy. List the contents of a directory hadoop fs -ls folderPath Example: To list the contents of the folder hdfs:/input/ hadoop fs -ls /input/data To list all the files recursively in all subfolders hadoop fs -ls -R /input/data To remove … Read more