[PDF]NHL Historical Archive What Codec/Wrapper do I use? - Rackcdn.coma9741fee2b7fa8a62c6e-7e59caeee4357e6424d664705984aec3.r59.cf1.rackcdn.com/...
2 downloads
139 Views
5MB Size
NHL Historical Archive What Codec/Wrapper do I use? Key considerations: •Interoperability •Supportability •Quality •Longevity. Do I need an intermediate? AVC-Intra100, Quicktime. Broad NLE support, easily re-wrapped, full-raster, i-frame, future enhancements in same codec family. NHL valued the image quality, support for existing FCP and Grass Valley infrastructure, and compatibility with P2 acquisition workflows. We chose to forgo an intermediate format because timeliness requirements and heavily partial-filerestore centric workflows made the time/bandwidth savings of an additional format unnecessary.
NHL Historical Archive Where do my assets come from? Key considerations: •Heterogeneity of asset codec/wrapper •Timeliness •Lifecycle
Arena Grass Valley Servers, P2 Cameras. We enjoy the benefits of a fairly homogenous variety of source formats as 90% of our content is coming in as either native AVCi-100 or as legacy DVCPRO HD drastically reducing dependence on transcoding for full-res workflows. Our expectations that future AVCi enhancements should allow us to ensure a long archive lifecycle from a codec standpoint is an important side-benefit.
NHL Historical Archive How fast does my repository grow? Key Considerations: •Robot slot density •Externalization •Backup/off-site storage •Retrieval patterns •Asset usage patterns
With 1300+ games yearly and an explosion in remotely produced/acquired content - fast! Currently nearly 3PB/yr. This volume when housed in a data-center in Midtown Manhattan requires some carefully crafted choices when sizing or expanding tape robotics to meet this demand. Lack of physical space for slot expansion and usage/retrieval patterns drove our decision to externalize whole game encodes at season’s end. Melts and proxy footage are kept in the robot forever. Externalized assets are stored on shelves in our local physical library and copy 2s of all assets are shipped offsite.
NHL Historical Archive Where does my metadata come from? What does it look like? Key Considerations:
•Sources: •Telemetry •Statistics •Acquisition/Transmission •Logging •Portability. •Silo'd logging The NHL’s HITS system records and provides rich statistical metadata. We depend largely on statistical metadata for cataloging and identifying assets. We don’t do any enhanced production logging but are able to leverage clip selection in multiple silo’d applications to provide additional searchability for separate groups within the enterprise.
NHL Historical Archive How do I store assets? Key Considerations: •Storage Fabric •Disk performance metrics •Management •Expandability •Asset lifecycle
Multiple StorNext fiber-attached SAN volumes, managed by Dalet, with archival by Front Porch. Currently we have multiple vendors for SAN disk volumes and in future look to unify that part of the infrastructure to improve manageability at the array level. Each SAN volume serves a specific purpose - Acquisition/Transcode/Distribution, Editorial/Production, Project aging/archival. This is done to spread performance requirements optimally, provide relief valves during peak usage in one area or another, and to allow for more incremental expansion expense.
NHL Historical Archive What edit/graphics systems are in use? Key Considerations: •Workflow requirements •Format support •SAN storage optimization •Project archival/restoration
Final Cut Pro, After Effects. This informs many of the aforementioned choices as you will need to choose a shared filesystem, MAM, codec(s), and wrapper formats suited to your existing edit environments and workflows. The importance of speed and the ease of importing and exporting assets to/from your editorial/production systems can not be overstated. The complexity of the interactions between the different elements of an asset management system should remain largely hidden from end-users and the software they use to access and use those assets should enhance and not detract from that goal.
NHL Historical Archive Who and how many users need access? Key Considerations: •Remote access authorization & authentication •Proxy streaming (devices) •Expansion plans
Currently only internal users in our Active Directory forest have access. Any system you implement should be able to integrate with multiple user account stores, support remote webbased access (even if it is only used internally), and be able to scale to support hundreds of end-users in the near term and potentially scale to provide thousands (millions??). API-based access and Responsive designed UIs should be seen as major pluses. There remains many things to consider in this area: Fan access, web CMS search & retrieval, mobile device support, etc.
NHL Historical Archive How is file-based content Transported?
Key Considerations:
•WAN acceleration •Secure upload and download •FTP
Signiant agent-based and Media Exchange transport with some FTP distribution. We have endeavored to reduce/eliminate FTP with some success which is important because of the expense, manageability, and security problems associated with it but it remains stubbornly difficult to eliminate it entirely. All source asset ingest is currently powered by Signiant which allows us to make all game-based assets available for edit by 6AM the following morning - this would not be possible with a less efficient transfer protocol like FTP. Media Exchange enables us to send and receive filebased assets on an ad-hoc basis to RSN partners and to/from NHL field acquisition teams.
NHL Historical Archive How do we share content, with whom , and in which format(s)? Key Considerations:
•Transcode volume •Output formats •Streaming •Rights management •Bandwidth requirements •Scale •Aging policy Most transcodes are of content with durations of less than 10 minutes. Obviously this whole presentation could be spent on this topic alone and there would still remain much to discuss. Our partnership with Neulion who deftly handles all of our new-media (read web) asset distribution, means that we do not have to deal with the complexity of the myriad associated delivery bitrates and formats. We provide CableLabs compatible MPEG2 content to cable syndication partners and BRoll,Scenic, and Melt content to our broadcast partners via Aspera, Signiant, and Signiant Media Exchange. We provide this content in its native format and in MXF-wrapped EVS-ready XDCAM 422 format. Sharing Bandwidth management remains a challenge as does expansion.
NHL Historical Archive Workflows Ad-Hoc Content (scripts on ny-xsanxfer01 run out of /export/home/••••/svn/video/ny-xsanxfer01 and log to /export/home/••••/logs)
Neulion
Neulion Signiant Agent
ny-xsanxfer01 XSAN2 [DaletInbound/ AdHocRecords]
Front Porch
ny-xsanxfer01 [signiantAdhocMover.pl]
XSAN2 [Vodflow/ MAMProxy]
RadiantGrid
Episode
XSAN2 [Episode/ MeltProxy]
XSAN2 [Vodflow/Outgoing/ MAMProxy]
DALET
Asset type description
Archive vía Front Porch
Source material origination
NHL authored script
Signiant transfers
Transcode/rewrap
LAN File transfers
Asset w/proxy available in Dalet
ny- xsanxfer01 [meltRewrapToRadiant.pl]
NHL Historical Archive Workflows Melt rewrap and transcode (scripts on ny-xsanxfer01 run out of/export/ home/••••/svn/video/ny-xsanxfer01 and log to/ export/home/••••/logs)
ny-xsancifs01 XSAN2 [Episode/MeltProxy]
XSAN2 [Vodflow/Outgoing/ MAMProxy]
Arena (ie: avtnyr.nhl.com)
Episode
DALET
Asset type description
Archive vía Front Porch
Source material origination
NHL authored script
Signiant transfers
Transcode/rewrap
LAN File transfers
ny- xsanxfer01 [meltRewrapToRadiant.pl]
Asset w/proxy available in Dalet
NHL Signiant NY-AVT[1..6]
XSAN2 [Vodflow/ MAMProxy]
Front Porch
RadiantGrid
NHL Historical Archive Workflows Neulion Proxy retranscode (scripts on ny-xsanxfer01 run out of/export/ home/••••/svn/video/ny-xsanxfer01 and log to/ export/home/••••/logs)
ny-xsanxfer01 [neulionProxyMoveToRadiant.pl]
Neulion
XSAN2[Vodflow/ MAMProxy]
DALET
Asset type description
Archive vía Front Porch
Source material origination
NHL authored script
Signiant transfers
Transcode/rewrap
LAN File transfers
Neulion Signiant Agent
Asset w/proxy available in Dalet
RadiantGrid
ny-xsanxfer01 XSAN2 [/SigniantTransfers/ fromNeulion/archive/ proxy]
XSAN2 [Vodflow/Outgoing/ MAMProxy]
NHL Historical Archive Workflows VOD Highlights (scripts on ny-xsanxfer01 run out of /export/ home/••••/svn/video/ny-xsanxfer01 and log to / export/home/••••/logs)
ny-xsanxfer01 XSAN2 [DaletInbound/ VODHighlights]
Neulion Signiant Agent
Neulion
Front Porch
ny-xsanxfer01 [signiantVODMover.pl]
XSAN2 [Vodflow/ neulionHighlights/]
ny-xsanxfer01 [AVCi_highlightSubmitter.pl]
XSAN2 [Vodflow/Outgoing/VOD_Highlights] & XSAN2 [Vodflow/Outgoing/MAMProxy]
XSAN2 [Episode/ neulionVOD]
Episode
ny-xsanxfer01 [VODClipMover.pl]
XSAN2 [Vodflow/ Incoming]
ny-xsanxfer01 [meltRewrapToRadiant.pl]
RadiantGrid
Aspera Sync to Comcast, Versus, Perform, …
Asset type description
Archive vía Front Porch
Source material origination
NHL authored script
Signiant transfers
Transcode/rewrap
DALET
LAN File transfers
Asset w/proxy available in Dalet
NHL Historical Archive Sources
Processing
Destinations
Front Porch Diva Actors
Remotely produced piece
RadiantGrid Transcode cluster
Data LUN 1 - RAID 5 (C1)
Data LUN 2 - RAID 5 (C2)
Data LUN 3 - RAID 5 (C1)
Data LUN 4 - RAID 5 (C2)
Episode transcode cluster - long form and userinitiated Full-res files
Arena Grass Valley Encoders
Partial File Restores
Partial File Restores
Raw footage from Dalet
Dalet Proxy Storage
Transcoded Proxy
Final Cut Projects
Arena Signiant Servers Full-res Whole Games and Melts
Melts and Ad-Hoc XDCAM & DVCProHD for footage licensees
Statistical Metadata
Search and Retrieval
Downlinks and Ad-Hoc content B-Rolls, Best-Ofs, produced content for RSNs
NHL MPLS Network
Footage download
Live International Satellite and Fiber distribution
ENG/Shoot footage
NY HQ Control Room Game Feeds and Team Cam
NHL Live
Live game feeds
Clean feeds, team cam interviews, NHL Live, Event coverage Stats Data
Live streaming
Full-res syndication
Neulion Signiant Servers Streaming Highlights
NHL Historical Archive
The End Thank You!