Managing electronic waste: a global problem

Responsibilities surrounding digital waste are multi-faceted. On one side, it is governments’ responsibility to establish tighter border controls to better manage the flow of waste and make sure that it is not transferred to developing countries. On the other side, electronic device manufacturers must take accountability for their position by facilitating end-of-life management of their products. And consumers must be aware of the “invisible” consequences of their uses, since they are outsourced to other countries.

To understand how waste electric and electronic equipment (WEEE) is managed, we must look to the Bâle Convention of 1989. This multilateral treaty was initially intended to manage the cross-border movement of hazardous waste, to which WEEE was later added. “The Bâle Convention resulted in regional agreements and national legislation in a great number of countries, some of whom prohibit the export or import of WEEE,” says Stéphanie Reiche de Vigan, a research professor in sustainable development law and new technologies at Mines ParisTech. “This is the case for the EU regulation on transfer of waste, which prohibits the export of WEEE to third countries.” Nevertheless, in 2015 the EFFACE European research project, devoted to combating environmental crime, estimated that approximately 2 million items of WEEE leave Europe illegally every year. How can so much electronic waste cross borders clandestinely? “A lack of international cooperation hinders efforts to detect, investigate and prosecute environmental crimes related to electronic waste trafficking,” says the researcher. And even if an international agreement on WEEE were to be introduced, it would have little impact without real determination on the part of the waste-producing countries to limit the transfer of this waste. 

This is compounded by the fact that electronic waste trafficking is caught between two government objectives: punishing environmental crimes and promoting international commerce in order to recover market share in international shipping. To increase competitiveness, the London Convention of 1965 aimed at facilitating international shipping, allowed for better movement of vessels, merchandise and passengers through ports. “The results were a simplification of customs procedures to encourage more competitive transit through ports, and distortions of competition between ports of developed countries through minimum enforcement of regulations for cross-border transfer of electronic waste, in particular controls by customs and port authorities,” says Stéphanie Reiche de Vigan. The European Union observed that companies that export and import WEEE tend to use ports where the law was less enforced, and therefore less effective.

So how can this chain of international trafficking be broken? “The International Maritime Organization must address this issue in order to encourage the sharing of best practices and harmonize control procedures,” responds the research professor. It is the responsibility of governments to tighten controls at their ports to limit these crimes. And technology could play a major role in helping them do so. “Making it compulsory to install X-ray scanners in ports and use them to visualize the contents of containers could help reduce the problem,” says Stéphanie Reiche-de Vigan. At present, only 2% of all ocean containers worldwide are physically inspected by customs authorities.

What are the responsibilities of technology companies?

The digital technology chain is divided into separate links: mining, manufacturing, marketing and recycling. The various stages in the lifetime of an electronic device are therefore isolated and disconnected from one another. As such, producers are merely encouraged to collaborate with the recycling industry. “As long as the producers of electric and electronic equipment have no obligation to limit their production, cover recycling costs or improve the recyclability of their products, electronic waste flows cannot be managed,” she says. Solving this problem would involve reconnecting the various parts of the chain through a life cycle analysis of electric and electronic equipment and redefining corporate responsibilities.

Rethinking corporate responsibility would mean putting pressure on tech giants, but developed countries seem to be incapable of doing so. Yet, it is the governments that bear the cost of sorting and recycling. So far, awareness of this issue has not been enough to implement concrete measures that are anything more than guidelines. National Digital Councils in Germany and France have established roadmaps for designing responsible digital technology. They propose areas for future regulation such as extending the lifetime of devices. But there is no easy solution since a device that lasts twice as long means half as much production for manufacturers. “Investing in a few more companies that are responsible for reconditioning devices and extending their lifetime is not enough. We’re still a long way from viable proposals for the environment and the economy,” says Fabrice Flipo, a philosopher of science at Institut Mines-Télécom Business School.

Moreover, countries are not the only ones to come up against the power of big tech companies. “At Orange, starting in 2017, we tried to put a system in place to display environmental information in order to encourage customers to buy phones with the least impact,” says Samuli Vaija, an expert responsible for issues related to product life cycle analysis at Orange. Further upstream in the chain, this measure encouraged manufacturers to incorporate environmental sustainability into their product ranges. When it was presented to the International Telecommunication Union, Orange’s plan was quickly shut down by the American opposition (Apple, Intel), who did not wish to display information about the carbon footprint on its devices.  

Still, civil society, and NGOs in particular, could build political will. The main obstacle: people living in developed countries have little or no awareness of the environmental impacts of their excessive consumption of digital tools, since they are not directly affected by them. “Too often, we forget that there are also violations of human rights behind the digital tools our Western societies rely on, from the extraction of the resources required to manufacture equipment, to the transfer of the waste they produce after just a few years. From the first link to the last, it is primarily people living in developing countries that suffer the impacts of the consumption of those in developed countries. The health impacts are not visible in Europe, since they are outsourced,” says Stéphanie Reiche-de Vigan. In rich countries, is digital technology effectively enclosed in an information bubble containing only the sum of its beneficial aspects? The importance attributed to digital technology must be balanced with its negative aspects.

As such, “it is also the responsibility of universities, engineering schools and business schools to teach students about environmental issues starting at the undergraduate level, while incorporating life cycle analysis and concern for environmental and human impacts in their programs,” says Stéphanie Reiche-de Vigan. Educating students about these issues means bringing these profiles to the companies who will develop the tools of tomorrow and the agencies meant to oversee them.

fonds industrie

Capsit and Plas’tri, the first start-ups to receive “Industry & Energy 4.0” honor loans

After the “Digital” fund, Institut Mines-Télécom (IMT) and the Fondation Mines-Télécom launched a second fund last October called “Industry & Energy 4.0” and dedicated to the sciences of energy, materials and processes. The Capsit and Plas’tri start-ups incubated at IMT Atlantique and Mines Saint-Étienne respectively are the first to benefit from the honor loans of this new fund. 

 

[one_half][box type=”shadow” align=”” class=”” width=””]

Capsit is the first compact and connected machine that allows you to go from coffee bean to capsule in a fully automated way, with a wide range of coffee available to be packed into climate neutral capsules. Capsit will receive a €60,000 honor loan. Find out more

[/box][/one_half][one_half_last][box type=”shadow” align=”” class=”” width=””]

Plas’tri improves the efficiency of the waste treatment chain by using optics and data processing to improve sorting and create or standardize exchanges between the actors of the recycling chain. Plas’tri helps prevent the loss of material during the recycling process by proposing a device that can identify plastics and creating a platform to mutualize the transport of recyclable plastic deposits to the relevant recycler. Waste from sorting is thus limited and each item is identified and sent to the right outlet. Plas’tri was one of the 10 finalist start-ups of the Bercy IMT Innovation 2020 Prize. It will receive two honor loans for a total sum of €50,000. Find out more

[/box][/one_half_last]

Airstream Alvie Cobbaï

Airstream, Alvie and Cobbaï supported by the IMT Digital honor loan scheme

The members of the IMT Digital Fund IGEU, IMT and Fondation Mines-Télécom – held a meeting on 17 November. During the meeting, three start-ups from the Télécom Paris incubator were selected to receive support through seven honor loans for a total sum of €120,000.

 

[one_half][box type=”shadow” align=”” class=”” width=””]

Airstream is a new-generation project management platform that allows companies to better coordinate work packages and business teams during complex projects and programs. The start-up will receive a €40,000 honor loan. Find out more

[/box][/one_half][one_half_last][box type=”shadow” align=”” class=”” width=””]

Alvie proposes HYGO, a solution that turns any sprayer into a smart sprayer and helps farmers optimize the quantity of phytosanitary products used and increase the efficiency of bio-control for organic farming. Alvie will receive three honor loans for a total sum of €40,000. Find out more

[/box][/one_half_last]

[box type=”shadow” align=”” class=”” width=””]

Cobbaï proposes a SaaS for industrial actors to automate the analysis of their corporate textual data and boost their quality, maintenance and after-sales service performances. The start-up will receive three honor loans for a total sum of €40,000. Find out more

[/box]

Arsenic

Arsenic contamination of water: Detection and treatment challenges

Arsenic contamination of water, whether surface water or ground water, affects many parts of France. Such contamination may be the result of anthropogenic causes, linked to mining operations for example, or of natural causes in relation to changes in geological formations, as is the case in many countries such as India, Pakistan and Chili. In partnership with the Nuclear Materials Authority in Egypt and Guangxi University in China, a team of researchers from IMT Mines Alès has developed processes for treating contaminated water and detecting arsenic.

Arsenic may be present naturally in water used for irrigation and animal-rearing. In the majority of cases, these concentrations are low enough – less than 0.01 milligrams per liter – that they do not pose a risk to humans. Hoever, overexposure can have dramatic effects on fauna, flora and human health, by causing cancer and dermatological conditions for example.

Emblematic cases of anthropogenic contamination have been reported in relation to mining activities. In 2019, near the gold mine in Salsigne, in the south of France, children were overexposed to arsenic, probably spread through dust and the dissolution of arsenic from mine tailings. But natural phenomena, such as the infiltration of rainwater, the erosion of geological formations and soil leaching may also be the cause of contamination in many countries like India, China and Chili. 

“Unfortunately, the countries faced with this environmental and health challenge are often poor countries that don’t have access to the most advanced techniques for decontaminating water,” says Eric Guibal, a researcher at IMT Mines Alès“In these countries, communities often rely on low-tech processes to reduce the toxicity of catchment water. Trade-offs are made between effectiveness and production and operation costs, for example through pumping and filtration using iron oxides” he explains. Along with a team of colleagues and in partnership with the Nuclear Materials Authority in Egypt and Guangxi University in China, he has contributed to the development of a number of innovative materials for the detection and treatment of arsenic in contaminated water.

Materials that “like” arsenic

“What we’re proposing is not a technique that can replace those we already have to capture arsenic, but a complementary technique in order to improve decontamination,” adds Eric Guibal. These research teams have developed a range of adsorbants, materials that can bind ions or molecules, in order to capture arsenic. Based on the use of biopolymers (extracts of seaweed and crustacean shells), they provide an alternative to those produced from petroleum resources. “Replacing petroleum-sourced materials with renewable resources is, in itself, an important challenge for the future,” he says.

Read more on I’MTech: When plants help us fight pollution

“Environmentally-friendly management has brought us to the limits of these materials; so as to avoid depleting the biotype, we limit the scope of our processes to applications such as polishing treatment and for “niches,” he explains. Combining these processes with more conventional techniques  (including precipitation, filtration, etc.) makes it possible to significantly reduce the toxicity of effluents and their discharge and improve the quality of catchment water. The targeted field of application is therefore  in line with local applications limited to areas where water quality is critical.

Various materials have been developed, for example combining the biopolymer - chitosan, a crustacean shell extract  - with metal ions - such as molybdate - which have a particular affinity for arsenic ions. When they come together, the different ions form a complex, which, once immobilized, makes it possible to recover arsenic in solution. Furthermore, the synthesis of nanocomposites in the form of hollow spheres combining molybdate with other compounds (silicate and cellulose acetate) produces nano-objects that can be used for the detection, analysis and recovery of arsenic in solutions  with low levels of contamination.

Exemple d'adsorbants microporeux à base d'algues (alginate) pour l'arsenic.
Example of microporous adsorbants made from seaweed (alginate).

Another more recently developed material is based on the functionalization of a composite, a technique used to give a material certain specific properties.  By combining seaweed with a synthetic polymer, this adsorbant material makes it possible to extract arsenic in order to decontaminate effluent or catchment water. The challenge is to release the arsenic once the material has been saturated, in order to concentrate it and recycle the adsorbant for new treatment cycles.

From the lab to the world

Another advantage of these technologies is that they offer a primary biological material that provides an alternative to the more polluting processes currently in use.  But the innovation is struggling to gain acceptance outside the laboratory, in particular since manufacturers may be reluctant to change their processes. “It’s a process that companies don’t know about and there’s a fear that there won’t be the same reproducibility ,” he adds. The variability of the resource can be a deterrent for manufacturers in terms of ensuring production and reproducible properties.

But beyond that, there is also a certain competitiveness in terms of production lines. Manufacturers already have a process that works and for which there is a market, and may not necessarily feel a need to change in order to find alternatives to petroleum-based processes. “And yet, they must be proactive and anticipate the future of petroleum-based resources,” says Eric Guibal. “There are also profitability issues involved, and if the environmental cost of the processes were taken into account, this innovation may be more appealing,”  he concludes.

Tiphaine Claveau for I’MTech

Flood, soil erosion

Agricultural sediments transported by rivers

The QuASPEr project studied the Canche river basin in northern France to better understand the phenomenon of soil erosion and its related consequences. This knowledge aims to develop effective land management methods for municipalities without negatively affecting farmers’ work.

 

Heavy rain, dry land, sloping ground that has been tilled… and the soil erodes. This phenomenon of abrasion, in particular of agricultural soils, leads to a loss of fertile soils but also lowers water quality in rivers. For local stakeholders, this can be seen in the form of mud flows with silting of waterways and damage to infrastructures. Northern France, which is particularly  affected by this phenomenon, was the subject of the QuASPEr project (French acronym for Quantification, Analysis and Monitoring of  Erosive Processes), in partnership with the joint association Symcea, the Artois-Picardie Water Agency and two IMT schools. Claire Alary and Christine Franke, researchers at IMT Lille Douai and Mines ParisTech respectively, have studied the Canche river watershed to better understand this erosion and develop effective soil retention strategies. The team also includes Edouard Patault, a PhD student who studied the Canche river watershed for his thesis research.

“The aim of this project is to characterize, model and predict this phenomenon of erosion,” says Christine Franke. “And due to climate change, these phenomena will evolve – and not necessarily for the better. It’s important to have a clear understanding of these mechanisms to propose management plans,” adds  Claire Alary. The two researchers have been working on the topic for several years in an effort to gain a better understanding of the highest-risk areas in the region.

Soil erosion

To study the phenomenon of erosion, the first thing that is necessary is a good understanding of the area. “It’s not necessarily a phenomenon of heavy rain that causes this erosion,” says Christine Franke. A number of parameters must be taken into account and this phenomenon is highly variable. The first rains of the season can often trigger erosion since the soil is dry and erodes more easily. The duration and intensity of the rain are significant factors but the type of soil is also very important: soil composition, vegetation cover, the degree of slope of the land etc.

This soil erosion is a recurring problem and it is difficult to identify the causes. A watershed like that of the Canache river is divided into a number of small basins, and the researchers’ goal is to find out the precise area from which the eroded particles come. To do so, it is critical to have a precise understanding of the system at each instant. Installing a monitoring station allows for such an understanding, but very locally, and stations are too expensive to be placed throughout the watershed. They must therefore be combined with other techniques to get a clear view of the system and its variability over time. The researchers studied this through the magnetic fingerprint of the sediments, a technique they adapted to this erosion phenomenon.

“We installed a trap in the river to collect these sediments suspended in the water and then sent them to the laboratory to be studied,” explains  Christine Franke. The method is relatively easy to implement and accessible for the municipalities. Moreover, it is a non-destructive method, meaning that researchers can carry out several analyses on a single sample. In practice, what they study is the mineralogy of iron in the samples. “The iron particles present in agricultural soils are not the same as those found naturally in the river,” she adds.

They have a distinctive signature that allows researchers to differentiate between particles from rivers and from fields. “The eroded particles from the field will keep this signature for a fairly long time once they’re in the river,” explains the researcher. This erosion phenomenon is also characterized by a procession of geochemical elements for each material arriving in the river. “We know the chemical characteristics of the sources of the material, so we’re able to trace this signal back to determine the contributions of the sources from which the sediments originate,” says Claire Alary.

Photograph of a gully in the Canche river watershed.

Photograph of a gully in the Canche river watershed

 

Land management

This project seeks to better understand how the system functions overall in order to identify the most problematic areas and propose adapted solutions. Certain features have been installed to limit erosion, such as hedges and fascines. Fascines are bundles of branches arranged in a line to retain soil and combat erosion. While these measures are effective, they are not enough to prevent damage. By gaining a better understanding of erosion and of the watershed, complementary retention methods could be found to enhance the effectiveness of current methods.

The possibilities for this project continue today with the launch of the GeSS (Managing Sediments at the Source) project run by the Ecosed Digital 4.0 chair, led by Nor-Edine Abriak, a researcher at IMT Lille Douai, along with Fondation Mines Télécom. The challenge is to tackle this phenomenon of erosion at the source and in particular to work on reducing the transfer of sediments for better management of this phenomenon in the various regions.

 

Tiphaine Claveau

Europes green deal

Digital technology, the gap in Europe’s Green Deal

Fabrice Flipo, Institut Mines-Télécom Business School

[divider style=”normal” top=”20″ bottom=”20″]

[dropcap]D[/dropcap]espite the Paris Agreement, greenhouse gas emissions are currently at their highest. Further action must be taken in order to stay under the 1.5°C threshold of global warming. But thanks to the recent European Green Deal aimed at reaching carbon neutrality within 30 years, Europe now seems to be taking on its responsibilities and setting itself high goals to tackle contemporary and future environmental challenges.

The aim is to become a society which is “fair, prosperous and a modern, resource-efficient and competitive economy”. This should make the European Union a global leader in the field of the “green economy”, with citizens being placed at the heart of a “sustainable and inclusive growth”.

The deal’s promise

How can such a feat be achieved?

The green deal is set within a long-term political framework for energy efficiency, waste, eco-conception, circular economy, public purchase and consumer education. Thanks to these objectives, the UE  aims to reach the long-awaited decoupling:

“A direct consequence of the regulations put in place between 1990 and 2016 is that energy consumption has decreased by almost 2% and greenhouse gas emissions by 22%, while GDP has increased by 54% […]. The percentage of renewable energy has gone from representing 9% of total energy consumption in 2005 to 17% today.”

With the Green Deal the aim is to continue this effort via ever-increasing renewable energies, energy efficiency and green products. The sectors of textiles, building and electronics are now the center of attention as part of a circular economy framework, with a strong focus on repair and reuse, driven by incentives for businesses and consumers.

Within this framework, energy efficiency measures should reduce our energy consumption by half, with the focus on energy labels and the savings they have made possible.

According to the Green Deal, the increased use of renewable energy sources should enable us to bring the share of fossil fuels down to just 20%. The use of electricity will be encouraged as an energy carrier, and 80% of it should be renewable by 2050. Energy consumption should be cut by 28% from its current levels. Hydrogen, carbon storage and varied processes for the chemical conversion of electricity into combustible materials will be used additionally, enabling an increase in the capacity and flexibility of storage.

In this new order, a number of roles have been identified: on one side, the producers of clean products, and on the other, the citizens who will buy them. In addition to this mobilization of producers and of consumers, national budgets, European funding and “green” (private) finance will commit to the cause; the framework of this commitment is expected to be put in place by the end of 2020.

Efficiency, renewable energy, a sharp decrease in energy consumption, promises of new jobs: if we remember that back in the 1970s, EDF was simply planning on building 200 nuclear power plants by the year 2000 – following a mindset which associated consumption and progress – everything now suggests that supporters of the Negawatt scenario (NGOs, ecologists, networks of committed local authorities, businesses and workers) have won a battle which is historic, cultural (in terms of values and realization of what is at stake) and political (backed by official texts).

The trajectory of GHG in a 1.5°C global warming scenario.

 

According to the deal, savings made on fossil fuels could reach between €150 billion and €200 billion per year, to which would be added the amount of health costs that will be avoided, amounting to €200 billion a year and the prospect of exporting “green” products.. Finally, millions of jobs may be created, with retraining mechanisms for the sectors that are the most impacted, and support for low-income households.

Putting the deal to the test

A final victory? On paper, everything points that way.

However, it is not as simple at it seems, and the UE itself recognizes that improvements in the field of energy efficiency and the decrease in glasshouse gas emissions are currently stalling..

This is due to the following factors, in order of importance: economic growth; the decrease in energy efficiency savings, especially in the airline industry; the sharp increase in the number of SUVs; and finally, the upward adjustment of real vehicle emissions, following the “diesel gate” scandal (+30 %).

More seriously, the EU’s net emissions, which include those generated by imports and exports, have risen by 8% during the 1990-2010 period.

Efficiency therefore has its limits and savings are more likely to be made at the start than at the end.

The digital technology challenge

According to the Green Deal, ‘Digital technologies are a critical enabler for attaining the sustainability goals of the Green deal in many different sectors”: 5G, CCTV, Internet of things, cloud computing or AI. We have our doubts, however, as to whether that is true.

Several studies, including by the Shift Project, show that emissions from the digital sector have doubled between 2010 and 2020. They are now higher than those produced by the much-criticized civil aviation sector. The digital applications put forward by the European Green Deal are some of the most energy consuming, according to several case scenarios.

Can the increase in usage be offset by energy efficiency? The sector has seen tremendous progress, on a scale not seen in any other field. The first computer, the ENIAC, weighed 30 tons, consumed 150,000 watts and could not do more than 5,000 operations per second. A modern PC consumes 200 to 300 W, for the same available power as a supercomputer of the early 2000s which consumed 1.5 MW! Progress knows no bounds…

However, the absolute limit (the “Landauer limit”) was identified in 1961 and confirmed in 2012. According to the semiconductor industry itself, the limit is fast approaching in terms of the timeframe for the Green Deal, at a time when traffic and calculation power are increasing exponentially. Is it therefore reasonable to continue becoming increasingly dependent on digital technologies, in the hope that efficiency curves might reveal energy consumption “laws”?

Especially when we consider that the gains obtained in terms of energy efficiency have little to do with any shift towards more ecology-oriented lifestyles: the motivations have been cost, heat removal and the need to make sure our digital devices could be mobile so as to keep our attention at all times.

These limitations on efficiency explain the increased interest in more sparing use of digital technologies. The Conseil National du Numérique presented its roadmap shortly after Germany. However, the Green Deal is stubbornly following the same path: a path which consists in relying on an imaginary digital sector which has little in common with the realities of the sector.

Digital technologies, facilitating growth

Drawing from a recent article, the Shift Project sends a warning: “Up until now, rebound effects have tuned out to exceed the gains brought by technological innovation.” This conclusion has once more been recently confirmed.

For example, the environmental benefits of distance working have in fact been much smaller than those we were expecting intuitively, especially when not combined with other changes in the social ecosystem. Another example is that in its 2019 “current” scenario, the OECD predicted a threefold increase in passenger transport between 2015 and 2050, facilitated (and not impeded) by autonomous vehicles.

Digital technologies are a growth factor first and foremost, as Pascal Lamy, then Head of the WTO, said when he stated that globalization is based on two innovations: Internet and the container. An increase in digital technologies will lead to more emissions. And if this is not the case, it will be because of a change in how we approach ecology, including digital technologies.

We are justified in asking the question of what it is the Green Deal is really trying to protect: the climate or the digital markets for big corporations?

[divider style=”dotted” top=”20″ bottom=”20″]

Fabrice Flipo, Professor of social and political philosophy, epistemology and history of science and technology  at Institut Mines-Télécom Business School

This article is republished from The Conversation under the Creative Commons license. Read the original article (in French) here.

IA TV

The automatic semantics of images

Recognizing faces, objects, patterns, music, architecture, or even camera movements: thanks to progress in artificial intelligence, every plan or sequence in a video can now be characterized. In the IA TV joint laboratory created last October between France Télévisions and Télécom SudParis, researchers are currently developing an algorithm capable of analyzing the range of fiction programs offered by the national broadcaster.

 

As the number of online video-on-demand platforms has increased, recommendation algorithms have been developed to go with them, and are now capable of identifying (amongst other things) viewers’ preferences in terms of genre, actors or themes, boosting the chances of picking the right program. Artificial intelligence now goes one step further by identifying the plot’s location, the type of shots and actions, or the sequence of scenes.

The teams of France Télévisions and Télécom SudParis have been working towards this goal since October 2019, when the IA TV joint laboratory was created. Their work focuses on automating the analysis of the video contents of fiction programs. “Today, our recommendation settings are very basic. If a viewer liked a type of content, program, film or documentary, we do not know much about the reasons why they liked it, nor about the characteristics of the actual content. There are so many different dimensions which might have appealed to them – the period, cast or plot,” points out Matthieu Parmentier, Head of the Data & AI Department at France Télévisions.

AI applied to fiction contents

The aim of the partnership is to explore these dimensions. Using deep learning, a neural network technique, researchers are applying algorithms to a massive quantity of videos. The different successive layers of neurons can extract and analyze increasingly complex features of visual scenes: the first layer extracts the image’s pixels, while the last attaches labels to them.

Thanks to this technology, we are now able to sort contents into categories, which means that we can classify each sequence, each scene in order to identify, for example, whether it was shot outside or inside, recognize the characters/actors involved, identify objects or locations of interest and the relationships between them, or even extract emotional or aesthetic features. Our goal is to make the machine capable of progressing automatically towards interpreting scenes in a way that is semantically close to that of humans”, says Titus Zaharia, a researcher at Télécom SudParis and specialist in AI applied to multimedia content.

Researchers have already obtained convincing results. Is this scene set in a car? In a park? Inside a bus? The tool can suggest the most relevant categories by order of probability. The algorithm can also determine the types of shots in the sequences analyzed: wide, general or close-up shots. “This did not exist until now on the market,” says Matthieu Parmentier enthusiastically. “And as well as detecting changes from one scene to another, the algorithm can also identify changes of shot within the same scene.

According to France Télévisions, there are many possible applications. Firstly, the automatic extraction of the key frames, meaning the most representative image to illustrate the content of a fiction, for each sequence and according to aesthetic criteria. Then there is the identification of the “ideal” moments in a program to insert ad breaks. “Currently, we are working on fixed video shots, but one of our next aims is to be able to characterize moving shots such as zooms, traveling or panoramic shots. This could be very interesting for us, as it could help to edit or reuse contents”, adds Matthieu Parmentier.

Multimodal AI solutions

In order to adapt to the new digital habits of viewers, the teams of France Télévisions and Télécom SudParis have been working together for over five years. They have contributed to the creation of artificial intelligence solutions and tools applied to digital images, but also to other forms of content, texts and sounds. In 2014, the two entities launched a collaborative project, Média4Dplayer, a prototype of a media player designed for all four types of screens (TV, PC, tablet and smartphone). This would be accessible to all, and especially to elderly people or people with disabilities. A few months later, they were looking into the automatic generation of subtitles. The are several advantages to this: equal access to content and the possibility to view a video without sound.

In the case of television news, for example, subtitles are generated live by professionals typing, but as we have all seen, this can sometimes lead to errors or to delays between what is heard and what appears on screen,” explains Titus Zaharia. The solution developed by the two teams allows automatic synchronization for the Replay content offered by France TV. The teams were able to file a joint patent after two and a half years of development.

In time, we are hoping to be able to offer perfectly synchronized subtitles just a few seconds after the broadcast of any type of live television program,” continues Matthieu Parmentier.

France Télévisions still has issues to be addressed by scientific research and especially artificial intelligence. What we are interested in is developing tools which can be used and put on the market rapidly, but also tools that will be sufficiently general in their methodology to find other fields of application in the future,” concludes Titus Zaharia.