In my last blog, I compared Clojure to Scala when it came to coding micro-services. In this blog, I compare those same micro-services in terms of performance under load in AWS. Here are some answers to questions about the document below. In my next blog, I will share the outcome when comparing performance metrics for…
architecture, Technology
Micro-Services: Clojure vs Scala
by glenn •
In a previous post, I compared Scala and Clojure when it came to processing big data. In this post, I am comparing Scala and Clojure in the world of micro-services. Earlier, I had written a rudimentary news feed service in Clojure. Recently, I re-implemented the same news feed service in Scala. Given the same task,…
architecture, big data, Technology
Distributed Computing and Functional Programming
by glenn •
In a previous blog on some big data open source projects covered at OSCON 2014, I reviewed three distributed computing functional programming technologies by using them to write a simple aggregation report. In that blog, I mentioned reproducing the news feed performance map reduce job from a Clojure news feed service that I test ran…
architecture, big data, Technology
Functional Programming and Big Data
by glenn •
Functional Programming and Big Data for the Impatient Learn about the future of Functional Programming and Big Data by reading this evaluation of three relevant open source technologies; PigPen, Cascalog, and Apache Spark. A small report is written, that reports on the per minute count of post actions from a two hour test run of…
architecture, cloud computing, Technology
Building a Scalable News Feed Web Service in Clojure
by glenn • • 0 Comments
The company where I currently work pays for each engineer to go to the conference of their choice once a year. One of my co-workers decided to go to Java One. When he came back, he shared with us the theme for that year which was Functional Programming. I decided that it was time to…
architecture
Taming the Single Writer Principle: Mule vs Camel
by glenn • • 0 Comments
In the following article, you will find my write up of a weekend project exploring two implementations of a shard aware proxy that follows the content based router Enterprise Integration Pattern in order to enforce the single writer principle. One implementation uses the open source project Mule and the other integrates with Apache Camel. Here…
big data, Technology
Discovering Big Data with Open Source
by glenn • • 0 Comments
With all the media attention on big data and what part Hadoop plays in it, I thought that I would return to basics and blog about real-world Hadoop from a developer’s perspective. This is not about flume, falcon, impala, ambari, oozie, or sqoop. This is a story about a developer, a weekend, some data, and…
search, Technology
Embedding Lucene in Your Service
by glenn •
It is fairly easy to embed Lucene into your application at the service layer. This approach can add high performance keyword based search capability to your application.
big data, Technology
Using Embedded Domain Specific Languages in NoSQL Data Stores
by glenn • • 0 Comments
This story starts long ago with a Model Driven Software Development system that I wrote. The generated server side Java code used JDBC to access data in a database. Later on, I provided support for Cassandra, Amazon SimpleDB, and Solr by writing JDBC connectors for those NoSQL data stores. It was nothing fancy. I subclassed…
search, Technology
3 Ways to Customize Solr 4
by glenn •
Lucene/Solr is a full featured search engine and it is rare to need to extend its search capabilities. If you do find yourself needing something not available in vanilla Solr, then functions, request handlers, and search components are three basic ways to extend Solr with your own custom Java code to handle special search requirements.