BD director

数据场景丰富 – 电商 (Tmall? 评论,生意参谋,流量) – 快消 (商品管理,指标管理,) – 制造 (SAP,订单,库存,财务数据 -》 HDP) – ToB (交付环节的指标数据采集) – ToC (CRM – wechat触达,UPT,APT,留存率,用户-活跃度划分 – 唤醒)   搭建大数据部门,组建数据团队 2013 HSB* 2017 Trendy Strategy – POC, selling the benfit of using bigdata – educate stakeholder, and branding – get budget – setup team and platform – quick project/solution –… Continue reading BD director

Big data SMACK

https://dzone.com/articles/smack-stack-guide http://datastrophic.io/data-processing-platforms-architectures-with-spark-mesos-akka-cassandra-and-kafka/ https://blog.codecentric.de/en/2016/04/smack-stack-hands/ One characteristic of fast data applications is the ingestion of vast amounts of data streams. Note the big difference between ingestion and storage. Businesses require real-time analysis and the need to combine transactions on live data with real-time analytics Fast data applications solve three challenges: • Data streams analysis • Data pipelines… Continue reading Big data SMACK

Kubernetes

Install https://severalnines.com/blog/installing-kubernetes-cluster-minions-centos7-manage-pods-services Concepts Clusters Clusters are the set of compute, storage, and network resources where pods are deployed, managed, and scaled. Clusters are made of nodes connected via a “flat” network, in which each node and pod can communicate with each other. A typical Kubernetes cluster size ranges from 1 – 200 nodes, and it’s… Continue reading Kubernetes

#onenote# activemq

Features   ActiveMQ is an open source, Java Message Service (JMS) 1.1–compliant, message-oriented middleware (MOM) from the Apache Software Foundation that provides high availability, performance, scalability, reliability, and security for enterprise messaging.   the job of a MOM is to mediate events and messages among distributed applications, guaranteeing that they reach their intended recipients. So… Continue reading #onenote# activemq

#onenote# akka 2

Dispatchers Dispatchers An Akka MessageDispatcher is what makes Akka Actors “tick”, it is the engine of the machine so to speak. All MessageDispatcher implementations are also an ExecutionContext, which means that they can be used to execute arbitrary code, for instance Futures. Akka MessageDispatcher 是维持 Akka Actor “运作”的部分, 可以说它是整个机器的引擎. 所有的MessageDispatcher 实现也同时是一个 ExecutionContext, 这意味着它们可以用来执行任何代码,  缺省派发器 在没有为 Actor作配置的情况下,每个 ActorSystem 将有一个缺省的派发器。 缺省派发器是可配置的,缺省情况下是一个确定的default-executor的… Continue reading #onenote# akka 2