Migrate legacy video datastreams to MP4

Project:RUcore Jobs & Reports
Component:Job - production
Category:task
Priority:normal
Assigned:ibeard
Status:closed
Description

There are a number of resources in the repository with legacy presentation datastreams; FLV and MOV. MP4 datastreams need to be created and ingested for those resources. After that a cleanup/purging of the legacy video datastreams need to occur. Before purging those datastreams the analytics that have been created will need to be updated to use the new MP4 datastream. The first step is to identify those resources needing MP4 datastreams and ingesting those new datastreams.

I have created a report that is generated using the Fedora datastreamPaths table showing a realtime view of what resources need MP4, already have MP4, and have both MP4 and legacy datastreams.

https://rucore.libraries.rutgers.edu/reports/legacy-video/

Comments

#1

I have the first batch of 120 videos re-encoded and ready for replacement. I have uploaded them to the /home/ibeard/mov-migrate directory, and each video's filename corresponds to their PID (in the format rutgers-lib_xxxxx.mp4). List of filenames are attached as a TXT document. I'll have additional batches as the video encoder here continues to process the remaining objects, and will update this issue as needed.

#2

Assigned to:ibeard» chadmills

Isaiah,

Without looking at your list closely I assume these are all MP4-1 datastreams? I'll start working on an add job

Thanks,
Chad

#3

Correct, these are all to be MP4-1 datastreams.

#4

Just an update: I've finished incrementally transcoding all videos without MP4s on the list. The MP4 files are available for when Chad has the annotation tool changes worked out.

#5

Starting to chip away at these. Added the MP4 to the following:

19338
21790
27060
27061
27062
27063
27064
27065
27066
27067
27068
27069
27070
27071
27454
27517
27518
27519

#6

Migrated these.

27523
27525
27527
27528
27529
27530
27531
27532
27533
27534
27535
27536
27537
27538
27539
27540
27541
27542
27543
27545
27546
27547
27548
27549
27550
27551
27552
27553
27555
27556
27557

#7

Migrated these.

rutgers-lib_28125.mp4
rutgers-lib_28126.mp4
rutgers-lib_28127.mp4
rutgers-lib_28128.mp4
rutgers-lib_28129.mp4
rutgers-lib_28130.mp4
rutgers-lib_28131.mp4
rutgers-lib_29523.mp4
rutgers-lib_34303.mp4
rutgers-lib_34304.mp4
rutgers-lib_34306.mp4
rutgers-lib_34308.mp4
rutgers-lib_34326.mp4
rutgers-lib_34327.mp4
rutgers-lib_34329.mp4
rutgers-lib_34330.mp4

#8

Migrated these.

rutgers-lib_27520.mp4
rutgers-lib_27521.mp4
rutgers-lib_27522.mp4
rutgers-lib_27524.mp4
rutgers-lib_27526.mp4
rutgers-lib_27544.mp4
rutgers-lib_29292.mp4
rutgers-lib_29293.mp4
rutgers-lib_29294.mp4
rutgers-lib_29295.mp4
rutgers-lib_29296.mp4
rutgers-lib_29297.mp4
rutgers-lib_29298.mp4
rutgers-lib_29299.mp4
rutgers-lib_29300.mp4
rutgers-lib_29301.mp4
rutgers-lib_29302.mp4
rutgers-lib_29303.mp4
rutgers-lib_29512.mp4
rutgers-lib_29513.mp4
rutgers-lib_29514.mp4
rutgers-lib_29516.mp4
rutgers-lib_29517.mp4
rutgers-lib_29518.mp4
rutgers-lib_29519.mp4
rutgers-lib_29520.mp4
rutgers-lib_29521.mp4
rutgers-lib_29522.mp4
rutgers-lib_29524.mp4
rutgers-lib_29525.mp4
rutgers-lib_29526.mp4
rutgers-lib_29527.mp4
rutgers-lib_31239.mp4
rutgers-lib_31240.mp4
rutgers-lib_31241.mp4
rutgers-lib_31242.mp4
rutgers-lib_31243.mp4
rutgers-lib_31244.mp4
rutgers-lib_32843.mp4
rutgers-lib_32844.mp4
rutgers-lib_32845.mp4
rutgers-lib_32846.mp4
rutgers-lib_32847.mp4
rutgers-lib_32848.mp4
rutgers-lib_32849.mp4
rutgers-lib_32850.mp4
rutgers-lib_34233.mp4

#9

Migrated these.

rutgers-lib_34305.mp4
rutgers-lib_34500.mp4
rutgers-lib_34501.mp4
rutgers-lib_34502.mp4
rutgers-lib_34506.mp4
rutgers-lib_34507.mp4
rutgers-lib_34508.mp4
rutgers-lib_34509.mp4

Isaiah,

That accounts for everything in @rep-test/home/ibeard/mov-migrate. Let me know when you have uploaded some more files and I will continue. This has been working out well for me; I hope you agree.

Thanks,
Chad

#10

I have placed a second batch of 325 videos in the same location as before on rucore-test (/home/ibeard/mov-migrate), as a second batch. Previous batch was cleared out.

#11

Just migrated these.

rutgers-lib_36363.mp4
rutgers-lib_36364.mp4
rutgers-lib_36365.mp4
rutgers-lib_36366.mp4
rutgers-lib_36367.mp4
rutgers-lib_36368.mp4
rutgers-lib_36369.mp4
rutgers-lib_36370.mp4
rutgers-lib_36371.mp4
rutgers-lib_36372.mp4
rutgers-lib_36373.mp4
rutgers-lib_36374.mp4
rutgers-lib_36375.mp4
rutgers-lib_36423.mp4
rutgers-lib_36489.mp4
rutgers-lib_36850.mp4
rutgers-lib_36851.mp4
rutgers-lib_36852.mp4
rutgers-lib_36853.mp4
rutgers-lib_36854.mp4
rutgers-lib_36855.mp4
rutgers-lib_36856.mp4
rutgers-lib_36857.mp4
rutgers-lib_36858.mp4
rutgers-lib_36899.mp4
rutgers-lib_36949.mp4
rutgers-lib_37060.mp4
rutgers-lib_37063.mp4
rutgers-lib_37064.mp4
rutgers-lib_37065.mp4
rutgers-lib_37066.mp4
rutgers-lib_37067.mp4
rutgers-lib_37183.mp4
rutgers-lib_37184.mp4
rutgers-lib_37185.mp4
rutgers-lib_37187.mp4
rutgers-lib_37188.mp4
rutgers-lib_37189.mp4
rutgers-lib_37190.mp4
rutgers-lib_37192.mp4
rutgers-lib_37193.mp4
rutgers-lib_37194.mp4
rutgers-lib_37195.mp4
rutgers-lib_37196.mp4
rutgers-lib_37197.mp4
rutgers-lib_37198.mp4
rutgers-lib_37199.mp4
rutgers-lib_37200.mp4
rutgers-lib_37201.mp4
rutgers-lib_37202.mp4
rutgers-lib_37203.mp4
rutgers-lib_37204.mp4
rutgers-lib_37205.mp4
rutgers-lib_37206.mp4
rutgers-lib_37207.mp4
rutgers-lib_37208.mp4
rutgers-lib_37209.mp4
rutgers-lib_37210.mp4
rutgers-lib_37211.mp4
rutgers-lib_37212.mp4
rutgers-lib_37213.mp4
rutgers-lib_37214.mp4
rutgers-lib_37242.mp4
rutgers-lib_37243.mp4
rutgers-lib_37244.mp4
rutgers-lib_37245.mp4
rutgers-lib_37247.mp4
rutgers-lib_37248.mp4
rutgers-lib_37249.mp4
rutgers-lib_37250.mp4
rutgers-lib_37251.mp4
rutgers-lib_37345.mp4
rutgers-lib_37346.mp4
rutgers-lib_37347.mp4
rutgers-lib_37348.mp4
rutgers-lib_37349.mp4
rutgers-lib_37357.mp4
rutgers-lib_37361.mp4
rutgers-lib_37362.mp4
rutgers-lib_37386.mp4
rutgers-lib_37387.mp4
rutgers-lib_37388.mp4
rutgers-lib_37389.mp4
rutgers-lib_37390.mp4
rutgers-lib_37391.mp4
rutgers-lib_37588.mp4
rutgers-lib_37589.mp4
rutgers-lib_37590.mp4
rutgers-lib_37591.mp4
rutgers-lib_37592.mp4
rutgers-lib_37593.mp4
rutgers-lib_37594.mp4
rutgers-lib_37595.mp4
rutgers-lib_37596.mp4
rutgers-lib_37597.mp4
rutgers-lib_37598.mp4
rutgers-lib_37599.mp4
rutgers-lib_37600.mp4
rutgers-lib_37601.mp4
rutgers-lib_37602.mp4

#12

Migrated these.

rutgers-lib_37603.mp4
rutgers-lib_37604.mp4
rutgers-lib_37605.mp4
rutgers-lib_37646.mp4
rutgers-lib_37647.mp4
rutgers-lib_37648.mp4
rutgers-lib_37649.mp4
rutgers-lib_37650.mp4
rutgers-lib_37651.mp4
rutgers-lib_37652.mp4
rutgers-lib_37663.mp4
rutgers-lib_37664.mp4
rutgers-lib_37665.mp4
rutgers-lib_37666.mp4
rutgers-lib_37667.mp4
rutgers-lib_37668.mp4
rutgers-lib_37669.mp4
rutgers-lib_37670.mp4
rutgers-lib_37671.mp4
rutgers-lib_37672.mp4
rutgers-lib_37673.mp4
rutgers-lib_37674.mp4
rutgers-lib_37675.mp4
rutgers-lib_37676.mp4
rutgers-lib_37677.mp4
rutgers-lib_37678.mp4
rutgers-lib_37695.mp4
rutgers-lib_37696.mp4
rutgers-lib_37697.mp4
rutgers-lib_37698.mp4
rutgers-lib_37699.mp4
rutgers-lib_37700.mp4
rutgers-lib_37701.mp4
rutgers-lib_37702.mp4
rutgers-lib_37703.mp4
rutgers-lib_37704.mp4
rutgers-lib_37705.mp4
rutgers-lib_37706.mp4
rutgers-lib_37707.mp4
rutgers-lib_37708.mp4
rutgers-lib_37709.mp4
rutgers-lib_37710.mp4
rutgers-lib_37711.mp4
rutgers-lib_37712.mp4
rutgers-lib_37713.mp4

#13

Migrated these.

rutgers-lib_37714.mp4
rutgers-lib_37715.mp4
rutgers-lib_37716.mp4
rutgers-lib_37717.mp4
rutgers-lib_37718.mp4
rutgers-lib_37720.mp4
rutgers-lib_37721.mp4
rutgers-lib_37722.mp4
rutgers-lib_37723.mp4
rutgers-lib_37724.mp4
rutgers-lib_37725.mp4
rutgers-lib_37726.mp4
rutgers-lib_37727.mp4
rutgers-lib_37728.mp4
rutgers-lib_37729.mp4
rutgers-lib_37730.mp4
rutgers-lib_37731.mp4
rutgers-lib_37732.mp4
rutgers-lib_37733.mp4
rutgers-lib_37734.mp4
rutgers-lib_37735.mp4
rutgers-lib_37736.mp4
rutgers-lib_37737.mp4
rutgers-lib_37738.mp4
rutgers-lib_37739.mp4
rutgers-lib_37740.mp4
rutgers-lib_37741.mp4
rutgers-lib_37742.mp4
rutgers-lib_37743.mp4
rutgers-lib_37744.mp4
rutgers-lib_37745.mp4
rutgers-lib_37746.mp4
rutgers-lib_37747.mp4
rutgers-lib_37748.mp4

#14

Migrated these.

rutgers-lib_37761.mp4
rutgers-lib_37762.mp4
rutgers-lib_37763.mp4
rutgers-lib_37764.mp4
rutgers-lib_37766.mp4
rutgers-lib_37767.mp4
rutgers-lib_37768.mp4
rutgers-lib_37810.mp4
rutgers-lib_37811.mp4
rutgers-lib_37812.mp4
rutgers-lib_37813.mp4
rutgers-lib_37814.mp4
rutgers-lib_37815.mp4
rutgers-lib_37816.mp4
rutgers-lib_37817.mp4
rutgers-lib_37818.mp4
rutgers-lib_37862.mp4
rutgers-lib_38490.mp4
rutgers-lib_38498.mp4
rutgers-lib_38521.mp4
rutgers-lib_38522.mp4
rutgers-lib_38523.mp4
rutgers-lib_38524.mp4
rutgers-lib_38541.mp4
rutgers-lib_38542.mp4
rutgers-lib_38543.mp4
rutgers-lib_38544.mp4
rutgers-lib_38545.mp4
rutgers-lib_38546.mp4
rutgers-lib_38547.mp4
rutgers-lib_38548.mp4
rutgers-lib_38549.mp4
rutgers-lib_38550.mp4
rutgers-lib_38551.mp4
rutgers-lib_38552.mp4
rutgers-lib_38553.mp4
rutgers-lib_38554.mp4
rutgers-lib_38555.mp4
rutgers-lib_38556.mp4
rutgers-lib_38557.mp4
rutgers-lib_38692.mp4
rutgers-lib_39090.mp4
rutgers-lib_39091.mp4
rutgers-lib_39092.mp4
rutgers-lib_39093.mp4
rutgers-lib_39094.mp4
rutgers-lib_39095.mp4
rutgers-lib_39096.mp4
rutgers-lib_39097.mp4
rutgers-lib_39107.mp4
rutgers-lib_39209.mp4
rutgers-lib_39210.mp4
rutgers-lib_39211.mp4
rutgers-lib_39212.mp4
rutgers-lib_39213.mp4
rutgers-lib_39214.mp4
rutgers-lib_39232.mp4
rutgers-lib_39969.mp4
rutgers-lib_39970.mp4
rutgers-lib_39971.mp4
rutgers-lib_40003.mp4
rutgers-lib_40006.mp4
rutgers-lib_40007.mp4
rutgers-lib_40008.mp4
rutgers-lib_40146.mp4
rutgers-lib_40147.mp4
rutgers-lib_40148.mp4
rutgers-lib_40440.mp4
rutgers-lib_40441.mp4
rutgers-lib_40442.mp4
rutgers-lib_40443.mp4
rutgers-lib_40444.mp4
rutgers-lib_40572.mp4
rutgers-lib_40573.mp4
rutgers-lib_40574.mp4
rutgers-lib_40575.mp4
rutgers-lib_40576.mp4
rutgers-lib_40577.mp4
rutgers-lib_40578.mp4
rutgers-lib_40579.mp4
rutgers-lib_40670.mp4
rutgers-lib_40671.mp4
rutgers-lib_40672.mp4
rutgers-lib_40673.mp4
rutgers-lib_40674.mp4
rutgers-lib_40675.mp4
rutgers-lib_40676.mp4
rutgers-lib_40677.mp4
rutgers-lib_40678.mp4
rutgers-lib_40679.mp4
rutgers-lib_40680.mp4
rutgers-lib_40681.mp4
rutgers-lib_40682.mp4
rutgers-lib_40683.mp4
rutgers-lib_40684.mp4
rutgers-lib_40685.mp4
rutgers-lib_40686.mp4
rutgers-lib_40711.mp4
rutgers-lib_40712.mp4
rutgers-lib_40713.mp4
rutgers-lib_40714.mp4
rutgers-lib_40715.mp4
rutgers-lib_40716.mp4
rutgers-lib_40717.mp4
rutgers-lib_40718.mp4
rutgers-lib_40719.mp4
rutgers-lib_40722.mp4
rutgers-lib_40768.mp4
rutgers-lib_40769.mp4
rutgers-lib_40857.mp4
rutgers-lib_41029.mp4
rutgers-lib_41030.mp4
rutgers-lib_41031.mp4
rutgers-lib_41032.mp4
rutgers-lib_41033.mp4
rutgers-lib_41034.mp4
rutgers-lib_41035.mp4
rutgers-lib_41036.mp4
rutgers-lib_41037.mp4
rutgers-lib_41038.mp4
rutgers-lib_41039.mp4
rutgers-lib_41040.mp4
rutgers-lib_41271.mp4
rutgers-lib_41275.mp4
rutgers-lib_41276.mp4
rutgers-lib_41277.mp4
rutgers-lib_41278.mp4
rutgers-lib_41279.mp4
rutgers-lib_41280.mp4
rutgers-lib_41288.mp4
rutgers-lib_41289.mp4
rutgers-lib_41290.mp4
rutgers-lib_41291.mp4
rutgers-lib_41292.mp4
rutgers-lib_41293.mp4
rutgers-lib_41294.mp4
rutgers-lib_41295.mp4

#15

Assigned to:chadmills» ibeard

Of the MP4 files in the mgiration directory these could not be used because they were 0 byte files.

rutgers-lib_38525.mp4
rutgers-lib_38533.mp4
rutgers-lib_38534.mp4
rutgers-lib_38535.mp4
rutgers-lib_38536.mp4
rutgers-lib_38537.mp4
rutgers-lib_38538.mp4
rutgers-lib_38539.mp4
rutgers-lib_38540.mp4

Also, I have used up everything in that migration directory. Please upload some more when you have a chance. Thanks.

#16

Assigned to:ibeard» chadmills

New videos have been uploaded to the same path as before. This should cover all or nearly all remaining videos.

#17

Assigned to:chadmills» ibeard

Added all of those on the server. Down to 80 more.

https://rucore.libraries.rutgers.edu/reports/legacy-video/

#18

Assigned to:ibeard» chadmills

Uploaded 76 new videos in the same path as previous. The remaining 4 do not appear to have active video datastreams; looking into this.

#20

Status:active» fixed

The remaining four objects now have MP4 datastreams added.

#21

Status:fixed» active

Awesome! I hate to say this, but there still two more. I found these while updating some published analytics to use the new MP4 datastreams. The two had the wrong MP4 file, probably my fault. The original MP4 have already been scrubbed. I hope you still have copies, if not they will need to be regenerated.

rutgers-lib:37590
rutgers-lib:37591

Sorry about that!

#22

Status:active» fixed

No worries. MP4s generated for these and added as datastreams.

#23

Status:fixed» closed

Thanks works great.

Back to top