Bandwidth Pricing Can Be Biggest Hurdle To REMI (At Home) Success

There’s been a lot of talk about the resource efficiencies related to remote operations for live production, but the cost of bandwidth to connect all of the disparate locations continues to make this way of working prohibitive for most second-tier producers.

While alternately called a remote-integration (REMI) model REMI and “At Home,” the practice involves producing a live event by separating the technical crew from the actual playing field, yet they are securely connected via fiber or IP networks as if they were in the next room or parked right outside a venue.

Using this new workflow, the football pitch could be in Germany while the director and TD sit in an IP-connected control room in Belgium—as production company Skynet iMotion Activities, in Belgium, now does regularly. Multiple productions for live coverage of the recent World Cup tournament in Russia were controlled and broadcast live (with a slight delay) from studios such as those of Fox Sports in California, as the games were played thousands of miles away. And ESPN’s use of a so-called “GREMI” model — in which graphics and some replay operators are located in Bristol, Connecticut, the company’s headquarters, while the equipment remains on a truck onsite somewhere else—continues to gain traction due to efficiencies in cost and human resources.

As the list of events produced this way continues to grow, however, the often exorbitant cost of establishing those dedicated wide area network (WAN) connections between sites is an unspoken hurdle many today—particularly second- or third-tier live productions—find hard to overcome, or even talk about. That, of course, is in addition to ensuring that you get all of the audio, video, timing and control aspects right.

One of the REMI control rooms at ESPN headquarters in Bristol, Conn., which can connect with remote resources via a few key strokes.

One of the REMI control rooms at ESPN headquarters in Bristol, Conn., which can connect with remote resources via a few key strokes.

“For some content properties that may have low (or no) rights fees, and minimal distribution and/or revenue associated with it, low cost production and low cost transmission services may be acceptable,” said Richard Wolf, executive vice present of marketing & corporate communications at The Switch, a global video transport services provider. “We know these types of properties as “C” and “D” tier events, where public internet tools for transport may offer acceptable risk/reward qualities for bandwidth services. "However, for many high-value content properties, the risks of relying on public internet tools may not be acceptable,” he said.

After a number of “no comment on cost” replies from several industry sources well versed in the matter, The Broadcast Bridge sought out pubic reports on the subject. Most said WAN pricing was dependent upon location and calculated on a per project or monthly subscription basis. As one example of the bandwidth costs, a market research firm called TeleGeography released a report in 2016 that stated that a 10 Gbps connection between Los Angeles and Tokyo could be as high as $50,000 a month. That’s for an uncompressed signal path. Compression (using HEVC) helps reduce that cost.

Vista Worldlink’s production facility in Ft. Lauderdale, FL takes a clean feed and integrates graphics and other elements for distribution. The company has completed hundreds of at-home–produced events for the United States Soccer League, National Women’s Soccer League, and others.

Vista Worldlink’s production facility in Ft. Lauderdale, FL takes a clean feed and integrates graphics and other elements for distribution. The company has completed hundreds of at-home–produced events for the United States Soccer League, National Women’s Soccer League, and others.

Wolf's company provides an “On-Net” presence at a customer location that can accommodate numerous transmit and receive video paths as needed. The company also helps its customers figure out the data requirements to support IP/File based workflows for comms, graphics, editing and more.

“You’ve got to ask questions, like ‘Is there an OTT workflow that needs to be supported, and if so, does the service provider support traditional linear distribution and non-linear (OTT/Direct-To-Consumer) delivery systems?’ And ‘can a traditional and/or virtual model work?’ There are many ways to drive value for bandwidth services and it starts with being on the same page as your customer.”

Andreas Hilmer, Director of Marketing & Communications at Lawo, said his company has helped many customers establish REMI connections in the most efficient way. This has included Arista Networks data switches, Lawo V_matrix virtualized routing, processing and multiviewing cores, Lawo VSM (Virtual Studio Manager) IP broadcast control system, 336 channels of EVS XT VIA (78 operator stations), a Telex Adam IP Comms system and a Meinberg redundant PTP station reference. The remote facilities included Sony XVS 8000 IP switchers, Lawo mc2 96 audio consoles, a Boland Communications UHD/HDR monitor wall and Ross Video Newt edge IP to SDI converters.

“[The cost of bandwidth connections] varies wildly depending on country/region, bandwidth and quality of connection,” he said. “As a general rule of thumb though, the cost is still significant enough that it only makes sense for venues where multiple events are scheduled over a period of time (for which a contract can be negotiated), preferably a number of years.”

Skynet iMotion Activities is a Belgian company that produces soccer telecasts for the country’s first and second division games. In Brussels they have built an all-IP control room for that’s equipped with traditional and IP-based technology. They cover eight stadiums in second division and stadiums in first division across the region, which are all connected via IP, while the actual control room production is done in Belgium. Only the cameras are on site. The director, EVS operator and everything else are located in Brussels.

“Distance is one factor for pricing for connectivity, crossing borders is another one,” Hilmer said. “Then there is competition amongst data line providers in a specific country or region. Compressed versus uncompressed is just short for how much bandwidth you need. The third factor is if you request dedicated connectivity (leased lines) versus the public Internet. The latter being much cheaper, but obviously not applicable for high-end live productions such as sports.”

Skynet iMotion Activities, in Belgium, produces soccer telecasts for the country’s first and second division games with a REMI workflow

Skynet iMotion Activities, in Belgium, produces soccer telecasts for the country’s first and second division games with a REMI workflow

At the root of a successful REMI (At Home) operation is the bandwidth and levels of service that can meet expectations. Bandwidth and technology providers have architected the right networks, with their own flavors of remote production capabilities, to meet the needs of the dynamic marketplace.

“The devil is in the details,” said Lawo’s Hilmer. “Just sending video over IP is the easy part!

With the industry now comfortable with various types of “cloud” approaches, where all signals are in a data center, individual production team members and production assets (mobile trucks and fixed studios) can be located anywhere as long as there is a reliable and fast connectivity. However the real key to successful REMI production is the ability for all sites to access a reliable, high-speed, low-latency telecom network. And that can be expensive.

You might also like...

HDR & WCG For Broadcast: Part 3 - Achieving Simultaneous HDR-SDR Workflows

Welcome to Part 3 of ‘HDR & WCG For Broadcast’ - a major 10 article exploration of the science and practical applications of all aspects of High Dynamic Range and Wide Color Gamut for broadcast production. Part 3 discusses the creative challenges of HDR…

IP Security For Broadcasters: Part 4 - MACsec Explained

IPsec and VPN provide much improved security over untrusted networks such as the internet. However, security may need to improve within a local area network, and to achieve this we have MACsec in our arsenal of security solutions.

Standards: Part 23 - Media Types Vs MIME Types

Media Types describe the container and content format when delivering media over a network. Historically they were described as MIME Types.

Building Software Defined Infrastructure: Part 1 - System Topologies

Welcome to Part 1 of Building Software Defined Infrastructure - a new multi-part content collection from Tony Orme. This series is for broadcast engineering & IT teams seeking to deepen their technical understanding of the microservices based IT technologies that are…

IP Security For Broadcasters: Part 3 - IPsec Explained

One of the great advantages of the internet is that it relies on open standards that promote routing of IP packets between multiple networks. But this provides many challenges when considering security. The good news is that we have solutions…