The patent has been granted The patent has been granted, Grant of patent is intended, Request for examination was made, The international publication has been made, unknown EP Register Verified

PROCESSING OF VIDEO STREAMS RELATED TO SURGICAL OPERATIONS

Publication No. EP4165548

•

App No. EP21737110

•

Filed by Fondation de Coopération Scientifique

•

Filed on 2021-06-11

•

Issued/Published on 2025-11-26

Official EPO Register

Publication No. EP4165548 A1

Application No. EP21737110 Filed: 2021-06-11

Grant Date 2025-11-26 Mention of grant

Active Oppositions 2 Active EPO Oppositions

Patent Abstract / Summary

Patent abstract is being processed or was not provided in English by the publishing office.

IPC Classifications

G06V20/40 G06K9/00

Priority Claims

FR 20200006178 Date: 2020-06-12

Designated Contracting States (38 EPC States)

AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

Parties & Representation

Applicants

Fondation de Coopération Scientifique

1 Place de l'Hôpital, 67000 Strasbourg

Université de Strasbourg

4, rue Blaise Pascal, 67000 Strasbourg

Centre National de la Recherche Scientifique (CNRS)

3 rue Michel-Ange, 75016 Paris

Università Cattolica del Sacro Cuore

Largo Agostino Gemelli 1, 20123 Milano

Institut De Recherche Contre Les Cancers De L'Appareil Digestif

1 Place de l'Hôpital, 67091 Strasbourg

Inventors (3)

PADOY, Nicolas

67000 Strasbourg

MASCAGNI, Pietro

00187 Roma

DALLEMAGNE, Bernard

4052 Beaufays

Representatives / Agents

Plasseraud IP

104 Rue de Richelieu, CS92104

Boult Wade Tennant LLP

Salisbury Square House, 8 Salisbury Square

Key Procedural Dates

Request-For-Examination 2022-12-16

Mention Of Grant Published 2025-11-26

First-Examination-Report-Despatched 2025-06-20

Patent Oppositions

Official opposition proceedings filed against European Patent EP4165548 under EPC Article 99.

2 ACTIVE OPPONENTS

Opponent Company

LapSx, Inc.

801 Travis Street, Suite 2101, PMB 2370, US

Representative

Boult Wade Tennant LLP

Filing Date

2026-08-26

Opposition in Progress

Opponent Company

LapSx, Inc.

801 Travis Street, Suite 2101, PMB 2370, US

Representative

—

Filing Date

2026-08-26

Opposition in Progress

Legal Status & Event History

Official European Patent Office legal and procedural status changes recorded for this file.

43 Events Recorded

Date	Code	Event Description	Auth
2021-07-15	STAA	INFORMATION ON THE STATUS OF AN EP PATENT APPLICATION OR GRANTED EP PATENT	EP
2021-12-17	STAA	INFORMATION ON THE STATUS OF AN EP PATENT APPLICATION OR GRANTED EP PATENT	EP
2023-03-17	PUAI	PUBLIC REFERENCE MADE UNDER ARTICLE 153(3) EPC TO A PUBLISHED INTERNATIONAL APPLICATION THAT HAS ENTERED THE EUROPEAN PHASE	EP
2023-03-17	STAA	INFORMATION ON THE STATUS OF AN EP PATENT APPLICATION OR GRANTED EP PATENT	EP
2023-04-19	17P	REQUEST FOR EXAMINATION FILED	EP
2023-04-19	AK	DESIGNATED CONTRACTING STATES	EP
2023-09-20	DAX	REQUEST FOR EXTENSION OF THE EUROPEAN PATENT (DELETED)	EP
2023-09-20	DAV	REQUEST FOR VALIDATION OF THE EUROPEAN PATENT (DELETED)	EP
2025-06-05	REG	REFERENCE TO A NATIONAL CODE	EP
2025-06-19	GRAP	DESPATCH OF COMMUNICATION OF INTENTION TO GRANT A PATENT	EP
2025-06-19	STAA	INFORMATION ON THE STATUS OF AN EP PATENT APPLICATION OR GRANTED EP PATENT	EP
2025-07-09	RIC1	INFORMATION PROVIDED ON IPC CODE ASSIGNED BEFORE GRANT	EP
2025-07-23	INTG	INTENTION TO GRANT ANNOUNCED	EP
2025-10-18	GRAS	GRANT FEE PAID	EP
2025-10-24	GRAA	(EXPECTED) GRANT	EP
2025-10-24	STAA	INFORMATION ON THE STATUS OF AN EP PATENT APPLICATION OR GRANTED EP PATENT	EP
2025-11-26	AK	DESIGNATED CONTRACTING STATES	EP
2025-11-26	REG	REFERENCE TO A NATIONAL CODE	EP
2025-12-18	REG	REFERENCE TO A NATIONAL CODE	EP
2025-12-17	REG	REFERENCE TO A NATIONAL CODE	EP
2026-01-15	REG	REFERENCE TO A NATIONAL CODE	EP
2026-01-28	U01	REQUEST FOR UNITARY EFFECT FILED	EP
2026-02-11	U07	UNITARY EFFECT REGISTERED	EP
2026-04-10	PG25	LAPSED IN A CONTRACTING STATE [ANNOUNCED VIA POSTGRANT INFORMATION FROM NATIONAL OFFICE TO EPO]	EP
2026-04-13	PG25	LAPSED IN A CONTRACTING STATE [ANNOUNCED VIA POSTGRANT INFORMATION FROM NATIONAL OFFICE TO EPO]	EP
2026-04-14	PG25	LAPSED IN A CONTRACTING STATE [ANNOUNCED VIA POSTGRANT INFORMATION FROM NATIONAL OFFICE TO EPO]	EP
2026-04-17	PG25	LAPSED IN A CONTRACTING STATE [ANNOUNCED VIA POSTGRANT INFORMATION FROM NATIONAL OFFICE TO EPO]	EP
2026-04-20	PG25	LAPSED IN A CONTRACTING STATE [ANNOUNCED VIA POSTGRANT INFORMATION FROM NATIONAL OFFICE TO EPO]	EP
2026-04-24	PG25	LAPSED IN A CONTRACTING STATE [ANNOUNCED VIA POSTGRANT INFORMATION FROM NATIONAL OFFICE TO EPO]	EP
2026-05-06	U20	RENEWAL FEE FOR THE EUROPEAN PATENT WITH UNITARY EFFECT PAID	EP
2026-07-01	REG	REFERENCE TO A NATIONAL CODE	EP
2026-07-03	PG25	LAPSED IN A CONTRACTING STATE [ANNOUNCED VIA POSTGRANT INFORMATION FROM NATIONAL OFFICE TO EPO]	EP
2026-07-09	PGFP	ANNUAL FEE PAID TO NATIONAL OFFICE [ANNOUNCED VIA POSTGRANT INFORMATION FROM NATIONAL OFFICE TO EPO]	EP
2026-07-21	PG25	LAPSED IN A CONTRACTING STATE [ANNOUNCED VIA POSTGRANT INFORMATION FROM NATIONAL OFFICE TO EPO]	EP
2026-07-25	PG25	LAPSED IN A CONTRACTING STATE [ANNOUNCED VIA POSTGRANT INFORMATION FROM NATIONAL OFFICE TO EPO]	EP
2026-08-27	PLAZ	EXAMINATION OF ADMISSIBILITY OF OPPOSITION: DESPATCH OF COMMUNICATION + TIME LIMIT	EP
2026-08-28	PLBI	OPPOSITION FILED	EP
2026-09-02	REG	REFERENCE TO A NATIONAL CODE	EP
2026-09-17	PLBA	EXAMINATION OF ADMISSIBILITY OF OPPOSITION: REPLY RECEIVED	EP
2026-09-18	PLAB	OPPOSITION DATA, OPPONENT'S DATA OR THAT OF THE OPPONENT'S REPRESENTATIVE MODIFIED	EP
2026-09-20	PLAX	NOTICE OF OPPOSITION AND REQUEST TO FILE OBSERVATION + TIME LIMIT SENT	EP
2026-09-23	REG	REFERENCE TO A NATIONAL CODE	EP
2026-09-30	26	OPPOSITION FILED	EP

Patent & Non-Patent Citations

Cited documents and prior art referenced in search and examination reports.

9 Citations

Cited Patent Documents

US2019069957 2019-03-07

Espacenet

US2019362834 2019-11-28

Espacenet

WO2019040705 2019-02-28

Espacenet

WO2020023740 2020-01-30

Espacenet

WO2021250362 2021-12-16

Espacenet

Non-Patent Scientific Literature (NPL)

- MASCAGNI PIETRO, VARDAZARYAN ARMINE, ALAPATT DEEPAK, URADE TAKESHI, EMRE TAHA, FIORILLO CLAUDIO, PESSAUX PATRICK, MUTTER DIDIER, M: "Artificial Intelligence for Surgical Safety: Automatic Assessment of the Critical View of Safety in Laparoscopic Cholecystectomy Using Deep Learning", ANNALS OF SURGERY, OVID TECHNOLOGIES (WOLTERS KLUWER HEALTH), vol. 275, no. 5, 1 May 2022 (2022-05-01), pages 955 - 961, XP093172792, ISSN: 0003-4932, DOI: 10.1097/SLA.0000000000004351 * Entire document, particularly pp. 955–960, p. 957 under “DeepCVS *

- D1a - PubMed record PMID 33201104, Bibliographic evidence for D1 (XP093172792) * Bibliographic record, particularly the entry identifying “Epub 2 *

- YUTONG XIE; JIANPENG ZHANG; YONG XIA; CHUNHUA SHEN: "A Mutual Bootstrapping Model for Automated Skin Lesion Segmentation and Classification", ARXIV.ORG, CORNELL UNIVERSITY LIBRARY, 201 OLIN LIBRARY CORNELL UNIVERSITY ITHACA, NY 14853, 8 March 2019 (2019-03-08), 201 Olin Library Cornell University Ithaca, NY 14853 , XP081597475 * Abstract, section III, particularly sections III-A and III-B, Fi *

- TWINANDA ANDRU P., SHEHATA SHERIF, MUTTER DIDIER, MARESCAUX JACQUES, DE MATHELIN MICHEL, PADOY NICOLAS: "EndoNet: A Deep Architecture for Recognition Tasks on Laparoscopic Videos", ARXIV.ORG, CORNELL UNIVERSITY LIBRARY, 9 February 2016 (2016-02-09), pages 1 - 11, XP093430220 * Abstract, sections I and III, particularly sections III-A and II *

Worldwide Patent Family

Related applications and patents in the same INPADOC worldwide family.

11 Family Members

Country	Publication Number	Kind	Publication Date	Action
EP	EP4165548A1	A1	2023-04-19	Espacenet
EP	EP4165548B1	B1	2025-11-26	Espacenet
EP	EP4165548C0	C0	2025-11-26	Espacenet
CA	CA3181667A1	A1	2021-12-16	Espacenet
FR	FR3111463A1	A1	2021-12-17	Espacenet
FR	FR3111463B1	B1	2023-03-24	Espacenet
JP	JP2023529223A	A	2023-07-07	Espacenet
KR	KR20230048298A	A	2023-04-11	Espacenet
US	US2023240788A1	A1	2023-08-03	Espacenet
US	US12582498B2	B2	2026-03-24	Espacenet
WO	WO2021250362A1	A1	2021-12-16	Espacenet

Official File Inspection EPC Art. 128 Public Dossier

Complete European Patent Register Dossier (148 Total Documents)

The full inspection file for Application EP21737110 contains 148 total documents, including all notices of opposition, proprietor counter-statements, examination communications, third-party observations, and procedural forms. Below are all major recorded procedural filings and publication specifications.

Open 148-Doc Register Dossier

Dossier Filing

Date: 2026-07-24 Procedure: Examination 0009250

Inspect on Register

PROCESSING OF VIDEO STREAMS RELATED TO SURGICAL OPERATIONS

Patent Abstract / Summary

IPC Classifications

Priority Claims

Designated Contracting States (38 EPC States)

Parties & Representation

Applicants

Inventors (3)

Representatives / Agents

Key Procedural Dates

Patent Oppositions

LapSx, Inc.

LapSx, Inc.

Legal Status & Event History

Patent & Non-Patent Citations

Cited Patent Documents

Non-Patent Scientific Literature (NPL)

Worldwide Patent Family

Complete European Patent Register Dossier (148 Total Documents)

Recorded Filings & Patent Specifications

European Patent Specification - Granted Patent (B1)

Official European Patent Register Full Dossier

European Patent Application with Search Report (A1)

Invitation to proprietor to file observations on the notice of opposition

New entry: Communication of a notice of opposition and request to file observations + time limit

Change - opposition data/opponent's data or that of the opponent's representative

New entry: Examination of admissibility of opposition: receipt of reply

Examination on admissibility of an opposition

Opposition filed

New entry: Examination of admissibility of opposition: despatch of communication + time limit

Lapse of the patent in a contracting state

Lapse of the patent in a contracting state

Lapse of the patent in a contracting state

Lapse of the patent in a contracting state

Lapse of the patent in a contracting state

Lapse of the patent in a contracting state

(Expected) grant

New entry: Payment of fee for grant

New entry: Payment of fee for publishing/printing

New entry: Receipt of the translation of the claim(s)

Intention to grant the patent

New entry: Communication of intention to grant a patent

Change - classification

New entry: Renewal fee paid

Renewal fee payment

New entry: Renewal fee paid

Renewal fee payment

Change - extension states

Change: Validation states

Amendment by applicant

Amendments

New entry: Renewal fee paid

Renewal fee payment

Publication in section I.1 EP Bulletin

The date on which the examining division becomes responsible, has been established

Request for examination filed

PCT data prior to European publication

PCT data prior to European publication

PCT data prior to European publication

PCT data prior to European publication

Change - representative

PCT data prior to European publication

Payment of national basic fee

Payment of the first designation fee

Payment of the fee for examination

Date on which the examining division has become responsible

New entry: applicant or inventor

PCT data prior to European publication

PCT data prior to European publication

New entry: applicant or inventor

PCT data prior to European publication

Validation of the patent

Extension of the patent

Language of the procedure

International searching authority