Apache Bigtop 1.3.0 release, big data package testing tools

Apache Bigtop

Apache Bigtop is an open source project for infrastructure engineers and data scientists designed to fully package, test, and deploy leading open source big data components/projects, including but not limited to Hadoop, HBase, and Spark. Support for Debian, Ubuntu, CentOS, Fedora, openSUSE and other operating systems.

  • Packaging – packages Hadoop RPMs and DEBs, so that you can manage and maintain your Hadoop cluster
  • Smoke testing – provides an integrated smoke testing framework, alongside a suite of over 50 test files
  • Virtualization – provides vagrant recipes, raw images, and (work-in-progress) docker recipes for deploying Hadoop from zero

Apache Bigtop 1.3.0 has been released.

Changelog

Sub-task

  • [BIGTOP-2833] – [puppetize.sh] Support centos-7-aarch64 support
  • [BIGTOP-2893] – Bump Hadoop to 2.8.1
  • [BIGTOP-2894] – Bump HBASE to 1.3.1
  • [BIGTOP-2895] – Bump Pig to 0.17.0
  • [BIGTOP-2897] – Bump Phoenix to 4.11-HBASE-1.3
  • [BIGTOP-2898] – Bug: regression in Phoenix build after BIGTOP-2895
  • [BIGTOP-2899] – Bug: regression in Oozie build after BIGTOP-2895
  • [BIGTOP-2949] – Add gradle task which leverage bigtop-ci/build.sh to build packages

Bug

  • [BIGTOP-2101] – ignite-hadoop contains an arch-dependent shared lib
  • [BIGTOP-2213] – tez build downloads amd64 nodejs executable
  • [BIGTOP-2292] – Remove Centos 6 Support
  • [BIGTOP-2503] – Solr packaging is broken on both DEB and RPM
  • [BIGTOP-2634] – package perl-Env does not exist in centos 6
  • [BIGTOP-2679] – Streamline CI Jobs
  • [BIGTOP-2723] – Fix asciidoctor-maven-plugin for HBase build on AArch64
  • [BIGTOP-2737] – Spark charm doesn’t handle HA or examples well
  • [BIGTOP-2738] – spark-worker fails to start
  • [BIGTOP-2748] – Fix a puppet compatibilty issue
  • [BIGTOP-2749] – puppet: use jessie package on jessie, not trusty
  • [BIGTOP-2750] – puppet: increase compatibility with future versions
  • [BIGTOP-2753] – Initial support for Debian-9
  • More

Download