UKNOF 29 Tech Recce – Belfast

Assembly Buildings Belfast - Main Hall

The venue for UKNOF 29 and ISOC’s ION Belfast meeting to be held in September this year is currently looking like another great place for UKNOF to meet – it’s the Assembly Buildings, right in the middle of the city, easy to get to, and a good choice of hotels (from budget options such as Travelodge through to mid-range Jury’s Inn, and the higher end Europa and boutique Fitzwilliam) all less than 2 minutes’ walk away. There’s also some smashing restaurants and bars for the all important networking we come to do at UKNOF.

Don’t be put off by the theatre seating above – this was for the event occurring the next day – we’re looking at either cabaret or classroom seating for our event, there will be somewhere to put your laptops!

We decided on this venue not just because of it’s central location, but the high specification of the AV and technical support provided in house. The home of the General Assembly of the Presbyterian Church in Ireland, the 109 year old building recently benefitted from a massive refurbishment, including a serious tech upgrade.

It has a Gig of bandwidth to the building. The UKNOF connectivity will use this as the transport to bring in our own Internet Access (over a tunnel) with no NAT and native IPv6, provided as usual by Tom at Portfast.

I recently visited to check this all works as anticipated, and it seems to work just fine. The tunnel to Portfast’s Docklands router came up just fine, and 80-90Mb (this being constrained by the router in use as the tunnel endpoint) was achieved with no issues.

The resident IT guys are super-helpful, and have even offered the use of their existing Aruba wifi platform for distributing the UKNOF wifi network in the building. If this works, it will mean that UKNOF doesn’t have to ship a load of access points out to the venue. Our testing revealed some limitations in the current Aruba setup, such as IPv6 RAs and ND apparently being blocked in the current config. Fixing this is on the list of things to do, as they don’t natively run v6 yet as part of their day to day operation so haven’t been concerned about it (until now).

We also need to investigate operating separate 2.4Ghz and 5Ghz wifi SSIDs, they are currently set up single SSID with bandsteering, so we may want to set up with specific radio heads as 5Ghz only.

This is all stuff to work on and resolve with their tech folks in the next few weeks.

Even if we decide we’d rather run our own access points because of the high client density at our meetings, this should be relatively simple and not require transporting lots of kit. The main hall can be covered by 4-6 access points, and there is plenty of structured cabling.

Assembly Buildings MixerAudio isn’t a problem. A rather nice Allen & Heath desk is permanently installed, and the standard rig includes plenty of radio handheld and lapel mics, and sidetone/foldback is provided for the presenter. On the day desk will be looked after by a professional sound engineer.

The venue even has it’s own permanently installed video system, comprising four HD pan-tilt-zoom cameras with video switching, that can provide an SDI out. Hopefully the folk over at Bogons who support UKNOF with webcasting can ingest this, and avoid having to bring their own camera.

If the big stage and stained glass window backdrop hasn’t scared you off yet, the Call for Presentations is open, and our regular Programme Committee has been strengthened by the addition of David Farrell from Tibus and Brian Nisbet of HEAnet for this meeting to help us find interesting local content.

The RIPE NCC will be holding their Basic and Advanced hands-on IPv6 training courses in the same venue (just a slightly smaller room!) on the Wednesday, Thursday and Friday of the same week.

We’re really looking forward to September, and welcoming Internet Operations folk from the whole of Ireland (both The North and The Republic), the UK mainland, and elsewhere to Belfast.

(It may even be the easiest UKNOF so far for the folk on the Isle of Man to get to?)

What’s meant by Regional Peering and the case for Peering NI

Last week, I was over in Dublin having been invited to give a talk by my gracious hosts at the Irish Internet Exchange Point, INEX. I asked what sort of thing they might like me to talk about. We agreed that I’d talk about various trends in global peering, mainly because the INEX meeting audience don’t do massive amounts of peering outside of the island of Ireland.

(If you need to understand the difference between the UK, Great Britain, Northern Ireland, the Republic of Eire and the island of Ireland this video will be a massive help. Thanks CGP Grey.)


One of the discussions we had was what is meant when we say “Regional” when talking about Internet Exchange points? In the UK, we generally mean exchanges which are outside of London, such as IX Leeds. When a “Regional IXP” is discussed in Africa, they actually mean a “super-national” IXP which possibly interconnects several countries across a region.

Why do the communities in these areas want IXPs that span national boundaries?

The main reason: latency.

There is a lot of suboptimal routing. Traffic being exchanged between adjacent countries on the same continent can end up making a long “trombone-shaped” trip to Europe and back. This has a negative effect on the user experience and on the local internet economy.

Round-trip times from RIPE Atlas probes in Southern African countries to a destination in South Africa
Round-trip times from RIPE Atlas probes in Southern African countries to a destination in South Africa

As you can see above, traffic from the test probes Kenya and Angola, along with the Maldives and the Seychelles is likely being routed to Europe for interconnection, rather than being handled more locally, if the round-trip time is an indication of route taken. The probes in Botswana, Zambia and Tanzania do somewhat better, and are definitely staying on the same continent. The African example is one of the obvious ones. Let’s look at something a bit closer to home…

Regional peering in Northern Ireland and Northern Ireland to the Republic of Ireland

There is already a well established exchange point in Dublin, INEX, with a good number of national and international members. Discussions are taking place between Internet companies in Northern Ireland (which, remember, is part of the UK) about their need for a more local place to exchange traffic, likely in Belfast. The current belief is a large amount of the traffic between sources and sinks in Northern Ireland goes to London or Amsterdam.

Firstly, how does traffic get from the UK (and by inference, most of the rest of Europe) and Northern Ireland? This is what Telegeography say:

Submarine Cables UK to NI
Submarine Cables UK to NI
RIPE Atlas Probes in Northern Ireland
RIPE Atlas Probes in Northern Ireland

So, I thought I’d do some RIPE Atlas measurements.

This isn’t meant to be an exhaustive analysis. More just exploring some existing theories and perceptions.

The first trick is to identify probes in Northern Ireland. From the RIPE PoV, these are all indicated as part of the UK (go and watch the video again if you didn’t get it the first time), so I can’t select them by country.

Fortunately, probe owners have to set their probe’s location – there is a certain amount of trust placed in them, there’s nothing stopping me saying my probe is somewhere else, but most probe owners are responsible techy types. The RIPE Atlas people also put the probe locations onto a coverage map.

I also needed some targets. Probes can’t ping each other (well, they can, if you know their IP address, and they’re not behind some NAT or firewall). The Atlas project provides a number of targets, known as “anchors”, as well as nodes in the NLnog ring which can act as targets. There’s an Atlas anchor in Dublin, but that couldn’t take any more measurements, so that wasn’t suitable as a target, but HEAnet (the Irish R&E network) and Amazon (yep, the folks that sell books and whatnot) have NLnog ring nodes in Dublin.

We also needed targets in Northern Ireland that seemed to answer ICMP relatively unmolested, and I chose DNS servers at Tibus and Atlas/Bytel, both of whom are ISPs in the North. The final things to add were “controls”, so I chose a friend’s NLnog ring box which I know is hosted in London, and two other UK-based Atlas probes, the one I have on my network at home, and one on Paul Thornton’s network in Sussex. These effectively provided known UK-Ireland and UK-NI latencies to the targets, and a known NI-London latency for the probes in NI.

So, let’s look at round-trip time from Northern Ireland to the NLnog ring node in London:

ICMP RTT NI Probes to NLnog ring server
ICMP RTT NI Probes to NLnog ring server

So, we can see there are some variations, no doubt based on last mile access technology. In particular, the node shown here with the 54ms RTT (just North of Belfast) consistently scored a high RTT to all test destinations. Anyway, this gives us an idea of NI-London RTT. The fastest being 15ms.

We can therefore make a reasonable assumption that if traffic were to go from Belfast to London and back to Ireland again, a 30ms RTT would be the best one could expect.

(For the interested, the two “control” test probes in the UK had latencies of 5ms and 8ms to the London target.)

Now, take a look at the RTT from Northern Ireland to the node at HEAnet in Dublin:

ICMP RTT all NI probes to HEAnet NLnog ring node, Dublin
ICMP RTT all NI probes to HEAnet NLnog ring node, Dublin

Only two of the probes in Northern Ireland have <10ms RTTs to the target in Dublin. All other probes have a greater RTT.

It is not unreasonable to assume, given that some have a >30ms RTT, or have exhibited a >15ms gain in RTT between the RTT to London and the RTT to Dublin, that this traffic is routing via London.

Of the two probes which show a <10ms RTT to HEAnet in Dublin, their upstream networks (AS43599 and AS31641) are directly connected to INEX.

Of the others, some of the host ASNs are connected to INEX, but the RTT suggests an indirect routing, possibly via the UK mainland.

The tests were also run against another target in Dublin, on the Amazon network, and show broadly similar results:

ICMP RTT NI probes to Amazon Dublin NLnog node
ICMP RTT all NI probes to Amazon NLnog ring node, Dublin

Again, the same two probes show <10ms RTT to Dublin. All others show >30ms. Doesn’t seem to matter if you’re a commercial or an academic network.

Finally, lets look at round trip times within Northern Ireland.

Here’s the test to a nameserver on the Tibus network:

ICMP RTT all NI Probes to Tibus Nameserver
ICMP RTT all NI Probes to Tibus Nameserver

Again, the same two probes report a lower than <10ms latency. I’d surmise that these are either routing via INEX, both host networks are downstream of the same transit provider in Belfast, or are privately interconnected in Belfast. At least two of the other nodes seem to route via the UK mainland.

To check this result, the same tests performed toward a nameserver on the Atlas/Bytel network:

ICMP RTT all NI probes to Atlas/Bytel Nameserver
ICMP RTT all NI probes to Atlas/Bytel Nameserver

Obviously, one of our probes is on-net, with a 1ms RTT!

Of the others, we’re definitely looking at “trombone routing” of the traffic, in most cases back to the UK mainland.

This may not be entirely surprising, as I’m told that BT don’t provide a 21CN interconnect node in Northern Ireland, so traffic on BT wholesale access products will “trombone” through the mainland in any case.

So, what’s really needed in Northern Ireland?

We’ve shown that if networks are willing to buy capacity to Dublin, they can happily exchange traffic at INEX and keep the latency down. An obvious concern some may have is the export of traffic from one jurisdiction to another, especially in light of recent revelations about systemic monitoring, if it’s NI to NI traffic.

The utility of IX in Northern Ireland could be hampered due to the lack of BT 21CN interconnect capability, as it may as well, for all intents and purposes be in Glasgow which is the nearest interconnect, for the traffic will still be making two trips across the Irish Sea whatever happens, assuming one end or the other is on the end of a BT wholesale pipe. (At worst, it could be 4 trips if both ends are on a BT pipe!)

If the goal is to foster internet growth (e.g. “production” of bandwidth) in Northern Ireland, where is it going to come from?

Are Northern Irish interests better served by connecting to the mature interconnect community in Dublin?

Is a BT 21CN interconnect in Belfast essential for growth, or can NI operators build around it?

Should INEX put a switch in Belfast? If they do, should it be backhauled to the larger community in Dublin? Or is that somehow overstepping the remit of an exchange point?