Excel is the original rapid application development tool. People do unholy things to get the job done with no code, or perhaps with just a smattering of VBA. These solutions can be brilliant in the moment but, long term, tend to end up brittle and hard to extend. Over the years there have been many approaches for extending Excel beyond formula soup and VBA. There is the excellent Excel-DNA, PyXLL, Microsoft’s own Office....
xllify is a platform I’ve released for creating custom Excel functions by describing what you need or pasting some existing formulas or VBA. The resulting functions get packaged into a ready-to-deploy Office Add-in for all versions of Excel, as well as an optional-extra native XLL build for Windows. Right now you can write your prompt for your functions in a browser or Excel add-in to iterate, debug and even manually code....
rtd.pub is a platform for easily connecting any real-time data source to Microsoft Excel. You can write code in Go and Python, or simply configure pre-built open source connectors. This is a design and approach I’ve been mulling over for the past couple of months. I have now implemented it. This, and of course spreadsheets in general, are somewhat boring. However, they’re the original low code/RAD tool: in terms of bang for buck and the control they put into the hands of domain experts, nothing comes close....
In the previous series of posts, we built a data model capable of filtering and paginating product comments with DynamoDB. This post explores how we could solve the same problem with Cloud Bigtable. You might wonder why another technology is now being discussed. It is my belief that a lot of the thinking that goes into a data model design is somewhat portable, whether it be DynamoDB, Cloud Bigtable, Cassandra, HBase, or maybe even Redis....
Today I discovered a ridiculously easy way to run a Druid cluster on GCP: flick a switch when creating a Cloud Dataproc cluster. It’s even a recent version (0.17 at time of writing). Great, right? (Assuming you don’t mind using something labelled alpha by Google.) Customisation There is literally no documentation other than the page I stumbled across: Cloud Dataproc Druid Component. After running up a small cluster, I noticed some things were missing:...
Update February 2019 — this post still gets a few views. Some of the content probably still makes sense, but Druid has moved on a lot.Managed services, SQL support, BI tools and so on. I’m still happily using it in production! The big data technology space is vibrant but crowded. There is a plethora of technologies, often appearing to be in competition with each other. There are several excellent SQL-on-Hadoop projects, for instance....