{"action":"created","issue":{"url":"https://api.github.com/repos/Netflix/vmaf/issues/89","repository_url":"https://api.github.com/repos/Netflix/vmaf","labels_url":"https://api.github.com/repos/Netflix/vmaf/issues/89/labels{/name}","comments_url":"https://api.github.com/repos/Netflix/vmaf/issues/89/comments","events_url":"https://api.github.com/repos/Netflix/vmaf/issues/89/events","html_url":"https://github.com/Netflix/vmaf/issues/89","id":237713760,"number":89,"title":"VMAF score is zero across several frames?","user":{"login":"lekzeey","id":10701561,"avatar_url":"https://avatars1.githubusercontent.com/u/10701561?v=3","gravatar_id":"","url":"https://api.github.com/users/lekzeey","html_url":"https://github.com/lekzeey","followers_url":"https://api.github.com/users/lekzeey/followers","following_url":"https://api.github.com/users/lekzeey/following{/other_user}","gists_url":"https://api.github.com/users/lekzeey/gists{/gist_id}","starred_url":"https://api.github.com/users/lekzeey/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/lekzeey/subscriptions","organizations_url":"https://api.github.com/users/lekzeey/orgs","repos_url":"https://api.github.com/users/lekzeey/repos","events_url":"https://api.github.com/users/lekzeey/events{/privacy}","received_events_url":"https://api.github.com/users/lekzeey/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":1,"created_at":"2017-06-22T02:16:42Z","updated_at":"2017-06-22T05:27:58Z","closed_at":null,"body":"Is this a bug or is something wrong with the model? I've used both ffmpegvmaf solution and even directly converted the inputs to the raw yuv format and then using run_vmaf but several frames in a row get a score of 0. \r\n\r\nHere is a snippet \r\n\r\n```\r\n\r\n        {\r\n            \"frameNum\": 3149, \r\n            \"VMAF_feature_adm2_score\": 0.18777403146762484, \r\n            \"VMAF_feature_motion2_score\": 0.0, \r\n            \"VMAF_feature_vif_scale0_score\": 0.04195884384335988, \r\n            \"VMAF_feature_vif_scale1_score\": 0.08855364552799247, \r\n            \"VMAF_feature_vif_scale2_score\": 0.10226445090778727, \r\n            \"VMAF_feature_vif_scale3_score\": 0.10459395357252557, \r\n            \"VMAF_score\": 0.0\r\n        }, \r\n        {\r\n            \"frameNum\": 3150, \r\n            \"VMAF_feature_adm2_score\": 0.1914710687993693, \r\n            \"VMAF_feature_motion2_score\": 0.0, \r\n            \"VMAF_feature_vif_scale0_score\": 0.04211828274754784, \r\n            \"VMAF_feature_vif_scale1_score\": 0.08896359219122792, \r\n            \"VMAF_feature_vif_scale2_score\": 0.10259623131730722, \r\n            \"VMAF_feature_vif_scale3_score\": 0.1043777529108215, \r\n            \"VMAF_score\": 0.0\r\n        }, \r\n        {\r\n            \"frameNum\": 3151, \r\n            \"VMAF_feature_adm2_score\": 0.1907573786299611, \r\n            \"VMAF_feature_motion2_score\": 0.000379, \r\n            \"VMAF_feature_vif_scale0_score\": 0.041465745476344525, \r\n            \"VMAF_feature_vif_scale1_score\": 0.08775040008985106, \r\n            \"VMAF_feature_vif_scale2_score\": 0.10113313232219975, \r\n            \"VMAF_feature_vif_scale3_score\": 0.10239778087801354, \r\n            \"VMAF_score\": 0.0\r\n        }, \r\n        {\r\n            \"frameNum\": 3152, \r\n            \"VMAF_feature_adm2_score\": 0.19076707800293727, \r\n            \"VMAF_feature_motion2_score\": 0.0, \r\n            \"VMAF_feature_vif_scale0_score\": 0.04144712716460506, \r\n            \"VMAF_feature_vif_scale1_score\": 0.08775434542624778, \r\n            \"VMAF_feature_vif_scale2_score\": 0.1011435197553379, \r\n            \"VMAF_feature_vif_scale3_score\": 0.10241793897120459, \r\n            \"VMAF_score\": 0.0\r\n        }, \r\n        {\r\n            \"frameNum\": 3153, \r\n            \"VMAF_feature_adm2_score\": 0.19137527176270244, \r\n            \"VMAF_feature_motion2_score\": 0.0, \r\n            \"VMAF_feature_vif_scale0_score\": 0.04007674001856412, \r\n            \"VMAF_feature_vif_scale1_score\": 0.08486254121296907, \r\n            \"VMAF_feature_vif_scale2_score\": 0.09723600047904274, \r\n            \"VMAF_feature_vif_scale3_score\": 0.0970543968664229, \r\n            \"VMAF_score\": 0.0\r\n        }, \r\n        {\r\n            \"frameNum\": 3154, \r\n            \"VMAF_feature_adm2_score\": 0.18194278306189662, \r\n            \"VMAF_feature_motion2_score\": 0.0, \r\n            \"VMAF_feature_vif_scale0_score\": 0.03926503200457012, \r\n            \"VMAF_feature_vif_scale1_score\": 0.08368120872642014, \r\n            \"VMAF_feature_vif_scale2_score\": 0.09566259901336759, \r\n            \"VMAF_feature_vif_scale3_score\": 0.09500753193635625, \r\n            \"VMAF_score\": 0.0\r\n        }, \r\n        {\r\n            \"frameNum\": 3155, \r\n            \"VMAF_feature_adm2_score\": 0.18207186988752105, \r\n            \"VMAF_feature_motion2_score\": 0.00188, \r\n            \"VMAF_feature_vif_scale0_score\": 0.040422883990877456, \r\n            \"VMAF_feature_vif_scale1_score\": 0.08505649637560102, \r\n            \"VMAF_feature_vif_scale2_score\": 0.09738503430924197, \r\n            \"VMAF_feature_vif_scale3_score\": 0.096331832964267, \r\n            \"VMAF_score\": 0.0\r\n        }, \r\n        {\r\n            \"frameNum\": 3156, \r\n            \"VMAF_feature_adm2_score\": 0.1800941061800006, \r\n            \"VMAF_feature_motion2_score\": 0.00188, \r\n            \"VMAF_feature_vif_scale0_score\": 0.04219385620393975, \r\n            \"VMAF_feature_vif_scale1_score\": 0.08726038599806475, \r\n            \"VMAF_feature_vif_scale2_score\": 0.10007589482740874, \r\n            \"VMAF_feature_vif_scale3_score\": 0.10042091310260892, \r\n            \"VMAF_score\": 0.0\r\n        }\r\n    ], \r\n    \"aggregate\": {\r\n        \"VMAF_feature_adm2_score\": 0.47931637531728954, \r\n        \"VMAF_feature_motion2_score\": 7.6866576050047515, \r\n        \"VMAF_feature_vif_scale0_score\": 0.11513697124678288, \r\n        \"VMAF_feature_vif_scale1_score\": 0.16862615752710952, \r\n        \"VMAF_feature_vif_scale2_score\": 0.1866348668537868, \r\n        \"VMAF_feature_vif_scale3_score\": 0.19312532668741608, \r\n        \"VMAF_score\": 9.83583753845461, \r\n        \"method\": \"mean\"\r\n    }\r\n```\r\n\r\nThis is super weird. If anyone has gotten this error before, please let me know. This is the result of a comparison between the AWS elastic transcoder and it's source.\r\nWhen I transcode the source video using ffmpeg with exactly the same settings as the AWS elastic transcode , I get this which result which is closer to what I'm expecting for the AWS elastic transcoder.\r\n\r\n```\r\n        {\r\n            \"frameNum\": 3149, \r\n            \"VMAF_feature_adm2_score\": 1.0128811514641758, \r\n            \"VMAF_feature_motion2_score\": 0.0, \r\n            \"VMAF_feature_vif_scale0_score\": 0.7720661307371304, \r\n            \"VMAF_feature_vif_scale1_score\": 0.9810677514600266, \r\n            \"VMAF_feature_vif_scale2_score\": 0.9934652376657016, \r\n            \"VMAF_feature_vif_scale3_score\": 0.9973464945079024, \r\n            \"VMAF_score\": 99.64428919878337\r\n        }, \r\n        {\r\n            \"frameNum\": 3150, \r\n            \"VMAF_feature_adm2_score\": 1.0128800895873187, \r\n            \"VMAF_feature_motion2_score\": 0.0, \r\n            \"VMAF_feature_vif_scale0_score\": 0.7725760590946087, \r\n            \"VMAF_feature_vif_scale1_score\": 0.9811771366777354, \r\n            \"VMAF_feature_vif_scale2_score\": 0.9934907720962023, \r\n            \"VMAF_feature_vif_scale3_score\": 0.9973505692210137, \r\n            \"VMAF_score\": 99.64573605045972\r\n        }, \r\n        {\r\n            \"frameNum\": 3151, \r\n            \"VMAF_feature_adm2_score\": 1.0128727440083964, \r\n            \"VMAF_feature_motion2_score\": 0.000345, \r\n            \"VMAF_feature_vif_scale0_score\": 0.7720576309200105, \r\n            \"VMAF_feature_vif_scale1_score\": 0.9810409469981245, \r\n            \"VMAF_feature_vif_scale2_score\": 0.9934206356769336, \r\n            \"VMAF_feature_vif_scale3_score\": 0.9972995810097431, \r\n            \"VMAF_score\": 99.63703341692192\r\n        }, \r\n        {\r\n            \"frameNum\": 3152, \r\n            \"VMAF_feature_adm2_score\": 1.0128815301284628, \r\n            \"VMAF_feature_motion2_score\": 0.0, \r\n            \"VMAF_feature_vif_scale0_score\": 0.7727966527447488, \r\n            \"VMAF_feature_vif_scale1_score\": 0.9812253762177078, \r\n            \"VMAF_feature_vif_scale2_score\": 0.9934841401397166, \r\n            \"VMAF_feature_vif_scale3_score\": 0.9973250224798983, \r\n            \"VMAF_score\": 99.64379803049617\r\n        }, \r\n        {\r\n            \"frameNum\": 3153, \r\n            \"VMAF_feature_adm2_score\": 1.01288146780093, \r\n            \"VMAF_feature_motion2_score\": 0.0, \r\n            \"VMAF_feature_vif_scale0_score\": 0.7727568230434121, \r\n            \"VMAF_feature_vif_scale1_score\": 0.9812171104962774, \r\n            \"VMAF_feature_vif_scale2_score\": 0.9934816324176424, \r\n            \"VMAF_feature_vif_scale3_score\": 0.9973248022496637, \r\n            \"VMAF_score\": 99.64363944360852\r\n        }, \r\n        {\r\n            \"frameNum\": 3154, \r\n            \"VMAF_feature_adm2_score\": 1.0128813800806988, \r\n            \"VMAF_feature_motion2_score\": 0.0, \r\n            \"VMAF_feature_vif_scale0_score\": 0.772749534618683, \r\n            \"VMAF_feature_vif_scale1_score\": 0.9812174501834594, \r\n            \"VMAF_feature_vif_scale2_score\": 0.9934831142534135, \r\n            \"VMAF_feature_vif_scale3_score\": 0.9973272249232007, \r\n            \"VMAF_score\": 99.64388729285774\r\n        }, \r\n        {\r\n            \"frameNum\": 3155, \r\n            \"VMAF_feature_adm2_score\": 1.0128957377127137, \r\n            \"VMAF_feature_motion2_score\": 0.001834, \r\n            \"VMAF_feature_vif_scale0_score\": 0.7727156311356612, \r\n            \"VMAF_feature_vif_scale1_score\": 0.9812366417607263, \r\n            \"VMAF_feature_vif_scale2_score\": 0.9934923531644574, \r\n            \"VMAF_feature_vif_scale3_score\": 0.9973343893148658, \r\n            \"VMAF_score\": 99.6505785504818\r\n        }, \r\n        {\r\n            \"frameNum\": 3156, \r\n            \"VMAF_feature_adm2_score\": 1.0129057792169165, \r\n            \"VMAF_feature_motion2_score\": 0.001834, \r\n            \"VMAF_feature_vif_scale0_score\": 0.7727289710781209, \r\n            \"VMAF_feature_vif_scale1_score\": 0.981253638178074, \r\n            \"VMAF_feature_vif_scale2_score\": 0.9934977468833491, \r\n            \"VMAF_feature_vif_scale3_score\": 0.9973351748479444, \r\n            \"VMAF_score\": 99.65314555031664\r\n        }\r\n    ], \r\n    \"aggregate\": {\r\n        \"VMAF_feature_adm2_score\": 0.9865332602629746, \r\n        \"VMAF_feature_motion2_score\": 7.649734763066202, \r\n        \"VMAF_feature_vif_scale0_score\": 0.7232064448804095, \r\n        \"VMAF_feature_vif_scale1_score\": 0.9471186673991454, \r\n        \"VMAF_feature_vif_scale2_score\": 0.9730892576880159, \r\n        \"VMAF_feature_vif_scale3_score\": 0.9841267786144647, \r\n        \"VMAF_score\": 97.80357431902264, \r\n        \"method\": \"mean\"\r\n    }\r\n```\r\n"},"comment":{"url":"https://api.github.com/repos/Netflix/vmaf/issues/comments/310279316","html_url":"https://github.com/Netflix/vmaf/issues/89#issuecomment-310279316","issue_url":"https://api.github.com/repos/Netflix/vmaf/issues/89","id":310279316,"user":{"login":"li-zhi","id":17128080,"avatar_url":"https://avatars3.githubusercontent.com/u/17128080?v=3","gravatar_id":"","url":"https://api.github.com/users/li-zhi","html_url":"https://github.com/li-zhi","followers_url":"https://api.github.com/users/li-zhi/followers","following_url":"https://api.github.com/users/li-zhi/following{/other_user}","gists_url":"https://api.github.com/users/li-zhi/gists{/gist_id}","starred_url":"https://api.github.com/users/li-zhi/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/li-zhi/subscriptions","organizations_url":"https://api.github.com/users/li-zhi/orgs","repos_url":"https://api.github.com/users/li-zhi/repos","events_url":"https://api.github.com/users/li-zhi/events{/privacy}","received_events_url":"https://api.github.com/users/li-zhi/received_events","type":"User","site_admin":false},"created_at":"2017-06-22T05:27:58Z","updated_at":"2017-06-22T05:27:58Z","body":"One possible cause is that the frames are misaligned. Can you try one thing: replace run_vmaf with run_psnr and report the result?"}}
{"actor":{"display_login":"li-zhi"}}