Home > Technical & Creative Skills > Programming, Servers & Scripts

Big Data Technologies and Data Analysis (2)


05-05-2016 03:35 PM #1 asknopt (Member)
Big Data Technologies and Data Analysis

Hey Guys,

So I'm wondering, is anyone here using Big Data stuff?

E.g. having an agent to consume Voluum REST API, and then put that into Dynamo or your own Elastic Search, and having it displayed on Kibana, or Grafana?

I guess it would be pretty cool to have visualize the traffic in real time (clicks, latency, money, conversions all in a dashboard) rather then keep refreshing Voluum.

Also the power of being able to do more than 3 dimension queries would be nice.

If I wanna do something like, give me all clicks that happened in IOS 9.3 and IOS9.2, exluding landing page A and D, and excluding website A and Z, on Monday and Tuesday, this would be literally impossible in Volum, unless you performed multiple queries and keep copy pasting to excel.


05-05-2016 03:54 PM #2 bobliu (Member)

As for the real time thing, perhaps something like Periscope? https://www.periscopedata.com/ There's a ton of options out there, not sure how they well they would integrate with your tracking solution.

Alternatively a very manual approach - if dealing with a hell of a lot of volume, you could look for experts in WEKA - a big data mining software, give them all your data in a .csv file and see if they can extract patterns from it + help you build machine learning algorithms to detect traffic patterns and do X if Y is true etc..


Home > Technical & Creative Skills > Programming, Servers & Scripts