This project has retired. For details please refer to its Attic page.

Analyze Big Data Platforms For Security and Performance

Install Apache Eagle Ambari Plugin

Assume Apache Eagle (called Eagle in the following) package has been copied and exacted under /usr/hdp/current/eagle.

WARNING: the following instructions work in sandbox currently.

Pre-requisites

  1. Create a Kafka1 topic if you have not. Here is an example command.

    $ /usr/hdp/current/kafka-broker/bin/kafka-topics.sh --create --zookeeper localhost:2181 --replication-factor 1 --partitions 1 --topic sandbox_hdfs_audit_log
    
  2. Stream HDFS log data to Kafka, and refer to here on how to do it .

Installation Steps

  1. Start dependent services Storm2, Spark3, HBase4 & Kafka via Ambari5.

  2. Install Eagle Ambari plugin

    $ /usr/hdp/current/eagle/bin/eagle-ambari.sh install
    
  3. Restart Ambari click on disable and enable Ambari back.

  4. Add Eagle Service to Ambari. Click on “Add Service” on Ambari Main page

    AddService Eagle Services

  5. Add Policies and meta data required by running the below script.

    $ cd <eagle-home>
    $ examples/sample-sensitivity-resource-create.sh
    $ examples/sample-policy-create.sh
    

Footnotes

  1. All mentions of “kafka” on this page represent Apache Kafka. 

  2. Apache Storm. 

  3. Apache Spark. 

  4. Apache HBase. 

  5. All mentions of “ambari” on this page represent Apache Ambari. 

Copyright © 2015 The Apache Software Foundation, Licensed under the Apache License, Version 2.0.
Apache Eagle, Eagle, Apache Hadoop, Hadoop, Apache HBase, HBase, Apache Hive, Hive, Apache Ambari, Ambari, Apache Spark, Spark, Apache Kafka, Kafka, Apache Storm, Storm, Apache Maven, Maven, Apache Tomcat, Tomcat, Apache Derby, Derby, Apache Cassandra, Cassandra, Apache ZooKeeper, ZooKeeper, Apache, the Apache feather logo, and the Apache project logo are trademarks of The Apache Software Foundation.