https://www.gravatar.com/avatar/f819a092b23cb25a09f87436f68df217?s=240&d=mp

Ang Gao

Software Engineer @ TripAdvisor, CS Ph.D @ University College Cork

Run Examples in Oozie

Extract Examples Tarball file 1 2 cd $OOZIE_HOME tar -xzvf oozie-examples.tar.gz Edit job.properties file 1 2 3 4 5 6 7 cd examples/apps/map-reduce vim job.properties nameNode=hdfs://YARN001:8020 jobTracker=YARN001:8032 queueName=default examplesRoot=examples Copy examples into HDFS 1 2 3 hadoop fs -put examples examples cd $OOZIE_HOME oozie job -oozie http://localhost:11000/oozie -config $OOZIE_HOME/examples/apps/map-reduce/job.properties -run

Apache Oozie Installation on Ubuntu

Followings steps are for: Ubuntu 14.04 LTS, Hadoop-2.6.0 Prerequisites: Ubuntu 14.04 Java JDK 1.7 Maven 3.0.5 Hadoop 2.6.0 Install Oozie 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 # install Maven sudo apt-get update sudo apt-get install maven # build Oozie wget http://mirrors.whoishostingthis.com/apache/oozie/4.1.0/oozie-4.1.0.tar.gz tar -xzvf oozie-4.

Hadoop: HDFS Shell Commands

1 2 3 4 5 6 bin/hdfs dfs run a filesystem command on the file systems supported in Hadoop. dfsadmin run a DFS admin client fsck run a DFS filesystem checking utility balancer run a cluster balancing utility 1 2 3 4 5 6 7 bin/hdfs dfsadmin [-safemode <enter | leave | get | wait>] [-saveNamespace] [-refreshNodes] [-setQuota <quota> <dirname>...<dirname>] [-setSpaceQuota <quota> <dirname>...<dirname>] 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 anggao@ubuntu:~/hadoop-2.

Hadoop: Setting up a Single Node Cluster

Purpose This document describes how to set up and configure a single-node Hadoop installation so that you can quickly perform simple operations using Hadoop MapReduce and the Hadoop Distributed File System (HDFS). Prerequisites GNU/Linux Java must be installed. Recommended Java versions are described at HadoopJavaVersions ssh must be installed and sshd must be running to use the Hadoop scripts that manage remote Hadoop daemons. A Hadoop distribution, download a recent stable release from one of the Apache Download Mirrors Installing Software Followings steps are for: Ubuntu 14.

JavaScript Note Two

Chapter Two: Program Structure Anything that produces a value is an expression in JavaScript The function Number converts a value to a number. The isNaN function is a standard JavaScript function that returns true only if the argument it is given is NaN. Chapter Three: Functions Variables declared outside of any function are called global, because they are visible throughout the program. Functions can be created inside other functions, producing several degrees of locality.

JavaScript Note One

Chapter One: Values, Types, and Operators #### Values There are six basic types of values in JavaScript: numbers strings Booleans objects functions undefined values Numbers JavaScript uses a fixed number of bits, namely 64 of them, to store a single number value. For very big or very small numbers, you can also use scientific notation by adding an e (for “exponent”), followed by the exponent of the number: 2.