Monday, July 20, 2020

kdb+/q - Try Catch

Programming languages typically have a try-catch mechanism for dealing with exceptions. The try block contains the code you want to execute and the catch block contains the code that will be executed if an error occurs in the try block.

Here is an example of a simple try-catch block in Java, which attempts to parse a string into an int and returns -1 if there is an error.

try {
    return Integer.parseInt(x);
} catch (NumberFormatException e) {
    return -1;

In this post, I will describe the try-catch equivalent for exception handling in the q programming language.

.Q.trp[f;x;g] - for unary functions

For unary functions, you can use .Q.trp (Extend Trap), which takes three arguments:

  1. f - a unary function to execute
  2. x - the argument of f
  3. g - a function to execute if f fails. This function is called with two arguments, the error string x and the backtrace object y

For example:

// Define a function which casts a string to int
parseInt:{[x] "I"$x}

// Define an error function which prints the stack trace and returns -1
// Note: .Q.sbt formats the backtrace object and 2@ prints to stderr
g:{[x;y] 2@"Error: ",x,"\nBacktrace:\n",.Q.sbt y;-1i}

// Try calling the function (wrapped by .Q.trp) with a valid argument

// Try calling the function (wrapped by .Q.trp) with an invalid argument
// The error function is called and the stack trace is printed
Error: type
  [2]  parseInt:{[x] "I"$x}
  [1]  (.Q.trp)

  [0]  .Q.trp[parseInt;`hello;g]

Note: An alternative is to use Trap At which has syntax @[f;x;e] but you won't get the backtrace, so it's better to use .Q.trp.

.[f;args;e] - for n-ary functions

.Q.trp only works for unary functions. For functions with more than one argument, you need to use Trap which has the syntax .[f;args;e]. The error function e does not take any arguments, which means no backtrace available. For example:

// Define a ternary function that sums its arguments
add:{[x;y;z] x+y+z}

.[add;1 2 3;{2@"Failed to perform add";-1}]

.[add;(1;2;`foo);{2@"Failed to perform add\n";-1}]
Failed to perform add

Friday, July 10, 2020

Compute MD5 Checksum Hash on Windows and Linux

Use the following commands to print out the MD5 hash for a file.

On Windows:

> CertUtil -hashfile myfile.txt MD5
MD5 hash of file myfile.txt:
CertUtil: -hashfile command completed successfully.

On Linux/Unix:

$ md5sum myfile.txt
76383c2c0bfca944b57a63830c163ad2 *myfile.txt

Sunday, May 17, 2020

Java 14: Helpful NullPointerException Messages

A new JVM option, -XX:+ShowCodeDetailsInExceptionMessages, has been introduced in Java 14, in order to provide helpful NullPointerException messages showing precisely what was null when a NullPointerException occurred. For example, consider the code below:

var name = library.get("My Book").getAuthor().getName();

Before Java 14, the JVM would only print the method, filename, and line number that caused the NPE:

Exception in thread "main" java.lang.NullPointerException
 at Library.main(

As you can tell, this error message is not very useful because it is impossible to determine which variable was actually null (without using a debugger). Was it the library, the book returned from the library, or the author of the book?

In Java 14, after enabling -XX:+ShowCodeDetailsInExceptionMessages, you will get the following message:

Exception in thread "main" java.lang.NullPointerException: 
Cannot invoke "Author.getName()" because the return value of "Book.getAuthor()" is null
 at Library.main(

The exception message pinpoints what was null (Book.getAuthor()) and also displays the action that could not be performed as a result of this (Author.getName()).

Monday, April 13, 2020

Java 14: Pattern Matching for instanceof

Java 14 introduces Pattern Matching for instanceof, another preview language feature, that eliminates the need for casts when using instanceof. For example, consider the following code:

if (obj instanceof String) {
    String s = (String) obj;

This code can now be rewritten as:

if (obj instanceof String s) {

As shown above, the instanceof operator now takes a "binding variable" and the cast to String is no longer required. If obj is an instance of String, then it is cast to String and assigned to the binding variable s. The binding variable is only in scope in the true block of the if-statement.

In particular, this feature makes equals methods a lot more concise as shown in the example below:

public boolean equals(Object obj) { 
  return this == obj || 
    (obj instanceof Person other) &&;

This feature is an example of pattern matching, which is already available in many other programming languages, and allows us to conditionally extract components from objects. It opens the door for more general pattern matching in the future which I am very excited about!

Saturday, April 11, 2020

Java 14: Records

Java 14 arrived a few weeks ago and introduces the Record type, which is an immutable data carrier class designed to hold a fixed set of fields. Note that this is a preview language feature, which means that it must be explicitly enabled in the Java compiler and runtime using the --enable-preview flag.

I'm going to jump straight in with an example of a Book record designed to hold the title, author, publish date and price of a book. This is how the record class is declared:

public record Book(String title, String author, LocalDate publishDate, double price) {

You can use javap to see the code that the compiler has autogenerated:

public final class Book extends java.lang.Record {
  public Book(java.lang.String, java.lang.String, java.time.LocalDate, double);
  public java.lang.String title();
  public java.lang.String author();
  public java.time.LocalDate publishDate();
  public double price();
  public java.lang.String toString();
  public final int hashCode();
  public final boolean equals(java.lang.Object);

As shown above, the compiler has automatically generated the constructor, getter methods, hashCode, equals and toString, thus saving us from having to type a lot of boilerplate code.

However, records do not just save on typing. They also make your intent clear that you want to model an immutable data item as a group of related fields.

Compact Constructors for Field Validation

Now let's say that you want to add validation and default values to your record. For example, you might want to validate that Book records are not created with negative prices or future publish dates. This can be done with a compact constructor as shown below:

public record Book(String title, String author, LocalDate publishDate, double price) {

  //compact constructor (no parameter list), used for validation and setting defaults
  public Book {
    if (price < 0.0) {
      throw new IllegalArgumentException("price must be positive");
    if (publishDate != null && publishDate.isAfter( {
      throw new IllegalArgumentException("publishDate cannot be in the future");
    } = author == null ? "Unknown" : author;

The compact constructor does not have a parameter list. It validates the price and publish date, and also sets a default value for the author. The fields that have not been assigned in this constructor (i.e. title, publishDate and price) are implicitly initialised at the end of this constructor.

Alternative Constructors and Additional Methods

Records allow you to define additional methods, constructors, and static fields, as shown in the code below. However, remember that semantically a record is designed to be a data carrier, so if you feel that are adding extra methods, it might be that you need a class instead of a record.

public record Book(String title, String author, LocalDate publishDate, double price) {

  // static field
  private static final String UNKNOWN_AUTHOR = "UNKNOWN";

  // compact constructor, used for validation and setting defaults
  public Book {
    if (price < 0) {
      throw new IllegalArgumentException("price must be positive");
    if (publishDate != null && publishDate.isAfter( {
      throw new IllegalArgumentException("publishDate cannot be in the future");
    } = author == null ? UNKNOWN_AUTHOR : author;

  // static factory constructor
  public static Book freeBook(String title, String author, LocalDate publishDate) {
    return new Book(title, author, publishDate, 0.0);

  // alternative constructor, without an author
  public Book(String title, LocalDate publishDate, double price) {
    this(title, null, publishDate, price);

  // additional method to get the year of publish
  public int publishYear() {
    return publishDate.getYear();

  // override toString to make it more user friendly
  public String toString() {
    return String.format("%s (%tY) by %s for £%.2f", title, publishDate, author, price);

Saturday, February 29, 2020

FFmpeg Cheatsheet

FFmpeg is a great command-line tool for dealing with audio and video files. Here are some useful commands:

1. Reduce the size of a file

Try passing the file straight through ffmpeg and check if the size reduces:

ffmpeg -i input.mp4 output.mp4

To reduce the size further, scale the video to half the width and height:

ffmpeg -i input.mp4 -vf "scale=iw/2:ih/2" output.mp4
2. Convert a MOV file to MP4
ffmpeg -i -vcodec h264 -acodec aac -strict -2 out.mp4
3. Create a video from an image by panning across it

If you have a landscape image, first set its height to 1600px, preserving aspect ratio (using an image editor such as IrfanView). Then run the following command to create a video which pans across the image from left to right:

ffmpeg -loop 1 -i input.jpg -vf crop=1200:ih:'min((iw/10)*t,9*iw/10)':0 -t 5 out.mp4

Wednesday, January 01, 2020 in 2019

Happy 2020, everyone!

I'd like to wish everyone a great start to an even greater new year!

In keeping with tradition, here's one last look back at in 2019.

During 2019, I posted 7 new entries on I am also thrilled that I have more readers from all over the world! Thanks for reading and especially for giving feedback.

Top 3 posts of 2019:

I'm going to be writing a lot more this year, so stay tuned for more great techie tips, tricks and hacks! :)

Related posts: