Joris de Vrede jorisdevrede

This is a tutorial on how to setup Kafka 0.9.0.0 on CentOS 7 with Kerberos. This configuration aims to set up all services on a single host called myserver.domain.com in the Kerberos realm DOMAIN.COM for testing purposes

Install JCE

This configuration requires that you have the Java Cryptography Extension (JCE) Unlimited Strength Jurisdiction Policy Files installed. You can download these from the Java Downloads page under the Additional Resources section.

Install Kerberos KDC

Ashrithr made a very helpful tutorial on how to install Kerberos. Please use these instructions to set up Kerberos.

Kopieer mij:

diamonds = sqlContext.sql("SELECT * FROM diamonds")
display(diamonds.select("*"))

Kopieer mij:

diamonds = sqlContext.sql("SELECT * FROM diamonds")

Import relevant Spark classes

Spark ML and SQL classes are considered optional and therefore not loaded by default. You will need to load these before proceding with ML.

from pyspark.ml import Pipeline
from pyspark.ml.feature import *
from pyspark.ml.classification import *
from pyspark.ml.evaluation import *

Java

sudo add-apt-repository ppa:webupd8team/java
sudo apt-get update
sudo apt-get install oracle-java8-installer
sudo apt-get install oracle-java8-set-default

Java Cryptography Extension (JCE) Unlimited Strength

To utilize 256 bits keys in Java, the following extensions need to be installed: Unlimited Strength Jurisdiction Policy Files (Java 8)

	from pyspark import SparkConf, SparkContext

	from operator import add


	def explode_coords(record):
	"""Restructure record into multi (coord, value) tuples

	Takes a list of [x-coord, y-coord, value] and explodes that
	into inverted tuples with a key (x,y) and a value v for all

	from argparse import ArgumentParser
	from logbook import Logger, StreamHandler

	import json
	import requests
	import sys
	import uuid

	StreamHandler(sys.stdout).push_application()
	log = Logger(__name__)

	sudo apt-get install -y software-properties-common
	sudo apt-add-repository -y ppa:ansible/ansible
	sudo apt-get update
	sudo apt-get install -y ansible
	echo 'set nocompatible' > ~/.vimrc

	sudo apt-get install -y maven

	sudo add-apt-repository ppa:webupd8team/java
	sudo apt-get update

	#!/usr/bin/env python

	from __future__ import print_function
	import argparse
	import re
	import os


	class HlogReader:
	type_principal = 1

	#!/usr/bin/env python
	import argparse
	import logging

	def main():
	logging.debug('main')

	if __name__ == '__main__':
	parser = argparse.ArgumentParser()
	parser.add_argument('--log',


	---

	- name: Reboot
	hosts: all
	become: yes

	tasks:

	- name: reboot system