End-to-end multi-view lipreading

S Petridis, Y Wang, Z Li, M Pantic - arXiv preprint arXiv:1709.00443, 2017 - arxiv.org
… In this work, we present an end-to-end model which jointly … first end-to-end model which
performs multi-view lipreading and … This means that multi-view lipreading can indeed enhance …

Multi-view automatic lip-reading using neural network

D Lee, J Lee, KE Kim - Computer Vision–ACCV 2016 Workshops: ACCV …, 2017 - Springer
end-to-end neural network architecture for speaker independent ALR task with multi-view
The evaluation is performed by experiments in single-view, cross-view, and multi-view setting. …

End-to-end sentence-level multi-view lipreading architecture with spatial attention module integrated multiple CNNs and cascaded local self-attention-CTC

S Jeon, MS Kim - Sensors, 2022 - mdpi.com
… To address this issue, we propose an end-to-end sentence-level multi-view VSR architecture
for … Thus, the suggested design enhances the performance of multi-view VSR and boosts its …

Lipper: Synthesizing thy speech using multi-view lipreading

Y Kumar, R Jain, KM Salik, RR Shah, Y Yin… - Proceedings of the AAAI …, 2019 - aaai.org
… In this section, we compare the end-toend delay in getting speech from Lipper and a similar
work of that of speechreading by (Petridis et al. 2017) thus confirming the validity of Lipper …

Multi-view Convolution for Lipreading

T Maeda, S Tamura - 2021 Asia-Pacific Signal and Information …, 2021 - ieeexplore.ieee.org
… design for multi-view lipreading. Our motivation is twofold. First, to achieve multiview lipreading
using only a few kinds of views for training because a multi-view synchronized data set is …

Deep view2view mapping for view-invariant lipreading

A Koumparoulis, G Potamianos - 2018 IEEE Spoken Language …, 2018 - ieeexplore.ieee.org
… In this paper we studied the problem of multiview lipreading. A deep-learning based image
… to, and thus can be used on already existent lipreading systems. We performed a number of …

Lip reading in profile

J Chung, A Zisserman - ritish Machine Vision Conference, 2017, 2017 - ora.ox.ac.uk
… scale dataset for multiview lip reading. The dataset is based on the Lip Reading Sentences
… on the SyncNet features have outperformed networks trained end-to-end on the task. This is …

MTGA: Multi-view Temporal Granularity aligned Aggregation for Event-based Lip-reading

W Zhang, J Wang, Y Luo, L Yu, W Yu, Z He - arXiv preprint arXiv …, 2024 - arxiv.org
End-to-end learning of representations for asynchronous eventbased data. In
Proceedings of the IEEE/CVF International Conference on Computer Vision. 5633–5643. …

End-to-end Lip-reading: A Preliminary Study

K Thapa - 2023 - openresearch.lsbu.ac.uk
… study of deep lip-reading, with a special focus on various end-to-end approaches. The …
whether a purely end-to-end approach is justifiable for a task as complex as deep lip-reading. To …

Lipper: Speaker independent speech synthesis using multi-view lipreading

KM Salik, S Aggarwal, Y Kumar, RR Shah… - Proceedings of the …, 2019 - ojs.aaai.org
… the first system to attempt speaker independent multi-view speech reconstruction. Both
speech reconstruction using lipreading and multi-view lipreading have not seen much research. …