Skip to main content

Posts

Showing posts from 2014

Microsoft Network Policy Server Synchronization Script

This powershell script is written for automating to export configuration from master NPS and then import it on a secondary NPS in order to keep a secondary NPS ready with latest configuration. Script must run on secondary node. The account that runs the script must be the member of both of the master and secondary servers local administrators group.

gcloud command not found error

In order to manage your Google Cloud Platform resources, Google Cloud SDK should be installed. Then Gloud command line utility comes with this SDK. But i encounter a problem with gloud command after installing on my Mint Linux. Even if i restarted terminal session, when i try to run 'gcloud auth login' command i encountered 'gcloud: command not found' error. That's because SDK installer put gloud binary's path using .bashrc file in the user's home directory. In my case i put these .inc files in .bash_profile, then restart terminal session:
# The next line updates PATH for the Google Cloud SDK. source '/home/kadir/google-cloud-sdk/path.bash.inc'
# The next line enables bash completion for gcloud. source '/home/kadir/google-cloud-sdk/completion.bash.inc'

Hbase Region is Multiply Assigned to Region Servers

After running hbase hbck command from command line, following errors says that  Hbase Region is Multiply Assigned to Region Servers. Status is inconsistent.
Number of Tables: 1
Number of live region servers: 8
Number of dead region servers: 0

........Number of empty REGIONINFO_QUALIFIER rows in .META.: 0
14/03/18 11:56:05 DEBUG client.HConnectionManager$HConnectionImplementation: The connection to hconnection-0x344d0b06aaa0028 has been closed.
ERROR: Region .META.,,1.1028785192 is listed in META on region server hdptest2.test.local:60020 but is multiply assigned to region servers hdptest2.test.local:60020, hdptest2.test.local:60020
ERROR: Region -ROOT-,,0.70236052 is listed in META on region server hdptest3.test.local:60020 but is multiply assigned to region servers hdptest3.test.local:60020, hdptest3.test.local:60020
ERROR: Region ambarismoketest,,1395071340885.7c4d1eb0609daaa87fd3b7a2bb725b44. is listed in META on region server hdptest4.test.local:60020 but is multiply assigned to reg…

Oozie says jar does not exist

After submitting an oozie shell action job, oozie logs say shell-launcher.jar does not exist.

JA008: File /var/tmp/oozie/oozie-oozi450698329702305.dir/shell-launcher.jar does not exist.

On the oozie server shell-luncher.jar exists in the local folder.

# locate shell-launcher.jar
/usr/local/oozie-3.3.2/distro/target/oozie-3.3.2-distro/oozie-3.3.2/oozie-server/temp/oozie-root3458733450304809568234.dir/shell-launcher.jar

In order to resolve this error, just crate hdfs folders and give appropriate permissions to them.

# su -l hdfs -c "hadoop fs -mkdir /var"
# su -l hdfs -c "hadoop fs -mkdir /var/tmp"
# su -l hdfs -c "hadoop fs -mkdir /var/tmp/oozie"
# su -l hdfs -c "hadoop fs -chmod -R 755 /var"
# su -l hdfs -c "hadoop fs -chown oozie:hdfs /var/tmp/oozie"

What Apache Ambari Does

Apache Ambari is used for:
Provisioning a Hadoop Cluster

Managing a Hadoop Cluster
Monitoring a Hadoop Cluster
Integrating Hadoop with Other Applications (Using REST APIs)