{"id":335,"date":"2026-09-01T17:41:46","date_gmt":"2026-09-01T17:41:46","guid":{"rendered":"https:\/\/bemjax.com\/blog\/?p=335"},"modified":"2026-09-01T17:43:47","modified_gmt":"2026-09-01T17:43:47","slug":"najnovije-u-svijetu-dekodiranja-kitovskog-govora","status":"publish","type":"post","link":"https:\/\/bemjax.com\/blog\/najnovije-u-svijetu-dekodiranja-kitovskog-govora\/","title":{"rendered":"What\u2019s new in whale speech decoding"},"content":{"rendered":"<p><em>Sperm whales talk in clicks. Over the last two years the way researchers represent that talk has changed from a flat list of labels into a factorised, compositional code \u2014 and the tools doing the factorising are the same generative models you already know. Here is where coda research stands, for a reader who knows some ML and nothing about whales.<\/em><\/p>\n<h2>1 &middot; What a coda is, and what the old representation was<\/h2>\n<p>Sperm whales emit two kinds of click: echolocation clicks for foraging sonar, and <strong>codas<\/strong> &mdash; short stereotyped sequences of 3&ndash;40 clicks, under two seconds long, exchanged in duet-like back-and-forth or in group chorus before diving and while socialising. They are <strong>never produced alone<\/strong>. That single constraint is the reason to treat a coda as communication rather than a by-product of sensing.<\/p>\n<p>Codas are <strong>culturally learned, not genetic<\/strong>. Whales segregate into vocal clans of hundreds or thousands that identify themselves by their coda repertoire; each clan dialect carries at least twenty coda types. What a whale &ldquo;says&rdquo; is decided by the clan it grows up in.<\/p>\n<p>Until 2024 the working representation was a flat categorical label set &mdash; roughly 20&ndash;40 &ldquo;coda types&rdquo; named by their inter-click-interval pattern (5R = five regular clicks; 1+1+3). A hand-built vocabulary of discrete labels laid over a continuous acoustic signal. Everything below is the story of replacing that label set with something factorised.<\/p>\n<p>The corpus is what makes it possible. The Dominica Sperm Whale Project has followed the <em>same identified families<\/em> off Dominica since 2005. Project CETI added fixed hydrophone arrays, clingfish-inspired suction-cup bio-logging tags (three synchronised hydrophones plus GPS, depth, temperature, light and motion), drones and gliders &mdash; about 10,000 coda recordings over two decades. The recordings did not exist before the instrument did.<\/p>\n<h2>2 &middot; 2024: from a label set to a factorised code<\/h2>\n<p>Sharma et al., <em>Nature Communications<\/em> 2024. Instead of asking <em>which of N labels is this coda<\/em>, ask <em>what dimensions generate it<\/em>. Four features &mdash; and the split between them is the actual finding:<\/p>\n<ul>\n<li><strong>rhythm<\/strong> &mdash; the pattern of inter-click intervals &mdash; <em>context-independent<\/em><\/li>\n<li><strong>tempo<\/strong> &mdash; overall duration \/ click rate &mdash; <em>context-independent<\/em><\/li>\n<li><strong>rubato<\/strong> &mdash; smooth variation of duration across successive codas in an exchange &mdash; <em>context-sensitive<\/em><\/li>\n<li><strong>ornamentation<\/strong> &mdash; an extra click appended to a coda within a run &mdash; <em>context-sensitive<\/em><\/li>\n<\/ul>\n<p>Rhythm &times; tempo cross into a combinatorial base; rubato and ornamentation modulate it according to the exchange the coda sits inside. The resulting inventory is <strong>nearly an order of magnitude larger<\/strong> than the coda-type list it replaces &mdash; proposed as a <em>sperm whale phonetic alphabet<\/em>, the first phonetic alphabet proposed for a non-human species.<\/p>\n<p>For an ML reader this is exactly the move from a categorical codebook to a <strong>factorised, compositional code with two context-invariant factors and two conditioned on the surrounding sequence<\/strong>. The context-dependence of half the factors is what makes it look like a system with structure rather than a fixed repertoire of calls.<\/p>\n<h2>3 &middot; 2025: an orthogonal spectral axis (vowels)<\/h2>\n<p>Begu&scaron; et al., <em>Open Mind<\/em> (MIT Press) 2025. Everything above reads <strong>timing<\/strong>. This reads the <strong>spectrum<\/strong>, and finds two recurrent, discrete coda-level spectral patterns &mdash; the <strong>a-coda vowel<\/strong> and the <strong>i-coda vowel<\/strong> &mdash; plus transitions between them inside a single coda, i.e. <strong>diphthongs<\/strong>.<\/p>\n<p>The load-bearing claim: these spectral properties <strong>combine freely with the timing features and are independent of coda type<\/strong>. Same rhythm, different vowel. The code has a whole axis nobody had been measuring.<\/p>\n<p>The human analogy is stated precisely: click count and click timing correspond to vowel <em>duration and pitch<\/em>; the spectral properties of the clicks correspond to <em>formants<\/em>. Mechanistically it is source&ndash;filter &mdash; the <strong>phonic lips<\/strong> vibrate as the source (as vocal folds do) and the <strong>distal air sac<\/strong> is hypothesised to act as the filter (as the vocal tract does), shaping the resonances that separate one coda vowel from another.<\/p>\n<p>One terminology trap worth flagging: a sperm whale click is <strong>not<\/strong> the click <em>consonant<\/em> of human phonetics (which is non-pulmonic and turbulent). It is better understood as a <strong>glottal pulse<\/strong> &mdash; the kind of thing that builds a vowel. Confusing the two poisons every analogy downstream. The paper also argues the pattern is structured and discretely distributed rather than a physical artefact of the whale&rsquo;s movement.<\/p>\n<h2>4 &middot; What the model says is there, and what nobody is claiming<\/h2>\n<p>The methodological problem is that there is <strong>no ground truth<\/strong>. You cannot ask the whale and you cannot label a held-out set. So the 2025 work inverts the question: train a generative model on raw audio, then interrogate what <em>it<\/em> treats as informative.<\/p>\n<p><strong>CDEV<\/strong> &mdash; causal disentanglement with extreme values (Begu&scaron;, Leban &amp; Gero, <em>Royal Society Open Science<\/em> 2025). Train on raw audio, then drive individual latent variables <strong>far past the range seen in training<\/strong>, and use causal inference to measure which observable properties of the output actually move. The architecture is <strong>fiwGAN<\/strong>, an InfoGAN adaptation of WaveGAN that splits its input into incompressible noise and a featural code, so the code can afterwards be read as what the network found worth encoding. Training set: 2,209 samples across the five commonest coda types.<\/p>\n<p>Four properties came out as information-carrying: <strong>number of clicks, regularity of click timing, spectral mean, acoustic regularity<\/strong>. Two were already hypothesised by biologists; two were not. That the model recovers the known two is what licenses belief in the new two. Generalisation check: the network generated codas resembling the <strong>9R<\/strong> type, which was never in its training data.<\/p>\n<p><strong>WhAM<\/strong> &mdash; Whale Acoustics Model, NeurIPS 2025. The first transformer that generates synthetic codas from any audio prompt, built by finetuning <strong>VampNet &mdash; a masked acoustic-token model pretrained on music<\/strong> &mdash; on the 10k coda corpus. Its learned representations classify rhythm, social unit and vowel well <em>despite being trained only to generate<\/em>. Code is open at <code>github.com\/Project-CETI\/wham<\/code>.<\/p>\n<p>And the unglamorous enabling piece: the <strong>first automatic coda detector and annotator<\/strong> (Gubnitsky et al., <em>Scientific Reports<\/em> 2025), built on graph-based clustering that exploits the expected similarity between the clicks <em>within<\/em> one coda. It works at low SNR, separates codas from echolocation clicks, and pulls apart codas from whales calling simultaneously.<\/p>\n<p><strong>Not claimed:<\/strong> no semantics, no translation, no ecological or behavioural causation &mdash; the CDEV paper says so in as many words. This is a <strong>phonology-scale<\/strong> result: an inventory and its combinatorics. It says the signal has more structure than the old label set could hold. It does not say what any of it means.<\/p>\n<hr \/>\n<p><strong>The whole region as a graph<\/strong> &mdash; Project CETI, its people, funders, instrument, field site and the research programme, 98 nodes laid out left-to-right: <a href=\"https:\/\/sprawl.bemjax.com\/viewer.html#r=2d&#038;e=29039,29040,29041,29042,29043,29044,29107,29132,29087,29045,29046,29049,29047,6928,29050,29052,29051,29103,29104,29105,29106,29109,29117,29121,29126,29134,29114&#038;n=29135:-2950,-1275;29136:-2950,-1125;29137:-2950,-975;29138:-2950,-825;29139:-2950,-675;29140:-2950,-525;29141:-2950,-375;29142:-2950,-225;29143:-2950,-75;29144:-2950,75;29145:-2950,225;29146:-2950,375;29147:-2950,525;29148:-2950,675;29149:-2950,825;29150:-2950,975;29151:-2950,1125;29152:-2950,1275;29134:-2500,0;29042:-880,-1020;29089:-1560,-1860;29090:-1560,-1710;29091:-1560,-1560;29092:-1560,-1410;29093:-1560,-1260;29094:-1560,-1110;29095:-1560,-960;29096:-1560,-810;29097:-1560,-660;29040:-620,0;29045:-1180,-560;29046:-1180,-410;29047:-1180,-260;6928:-1180,-110;29049:-1180,40;29050:-1180,190;29052:-1180,340;29051:-1180,490;29041:-620,1150;6933:-1180,760;29073:-1180,910;29072:-1180,1060;29074:-1180,1210;29075:-1180,1360;29078:-1180,1510;29079:-1180,1660;29081:-1180,1810;29082:-1180,1960;6875:-1560,835;12594:-1560,985;29080:-1560,1135;29083:-1560,1285;29084:-1560,1435;29085:-1560,1585;29086:-1560,1735;29039:0,0;29043:300,-1050;29098:700,-1750;29099:700,-1600;29100:700,-1450;29101:700,-1300;29102:700,-1150;29044:350,750;29103:800,700;29104:800,850;29105:800,1000;29106:800,1150;29087:-450,1550;29132:100,1250;29133:-50,1550;29285:300,1550;29179:100,1850;29250:450,1850;29107:700,0;29108:700,350;29116:1200,-1500;29109:1200,-1050;29115:1200,-600;29117:1200,-300;29121:1200,375;29126:1200,1200;29110:1650,-1350;14720:1650,-1200;29112:1650,-1050;29113:1650,-900;29114:1650,-750;29118:1650,-450;29119:1650,-300;29120:1650,-150;29122:1650,150;29123:1650,300;29124:1650,450;29125:1650,600;29127:1650,900;29128:1650,1050;29129:1650,1200;29130:1650,1350;29131:1650,1500&#038;v=0.227,848,439\" target=\"_blank\" rel=\"noopener\">open the interactive diagram<\/a>.<\/p>\n<p><strong>Sources<\/strong> (the four papers, plus the detector and WhAM):<\/p>\n<ul>\n<li>Rhythm \/ tempo \/ rubato \/ ornamentation &mdash; <a href=\"https:\/\/www.nature.com\/articles\/s41467-024-47221-8\" target=\"_blank\" rel=\"noopener\">Nature Communications 2024<\/a><\/li>\n<li>Coda vowels &mdash; <a href=\"https:\/\/direct.mit.edu\/opmi\/article\/doi\/10.1162\/OPMI.a.252\" target=\"_blank\" rel=\"noopener\">Open Mind 2025<\/a><\/li>\n<li>CDEV &mdash; <a href=\"https:\/\/royalsocietypublishing.org\/rsos\/article\/13\/8\/250829\" target=\"_blank\" rel=\"noopener\">Royal Society Open Science 2025<\/a><\/li>\n<li>Automatic coda detector &mdash; <a href=\"https:\/\/www.nature.com\/articles\/s41598-025-97009-z\" target=\"_blank\" rel=\"noopener\">Scientific Reports 2025<\/a><\/li>\n<li>WhAM &mdash; <a href=\"https:\/\/arxiv.org\/abs\/2512.02206\" target=\"_blank\" rel=\"noopener\">arXiv:2512.02206 (NeurIPS 2025)<\/a><\/li>\n<\/ul>\n","protected":false},"excerpt":{"rendered":"<p>Sperm whales talk in clicks. Over the last two years the way researchers represent that talk has changed from a flat list of labels into a factorised, compositional code \u2014 and the tools doing the factorising are the same generative models you already know. Here is where coda research stands, for a reader who knows [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[7],"tags":[],"class_list":["post-335","post","type-post","status-publish","format-standard","hentry","category-animal-cognition"],"_links":{"self":[{"href":"https:\/\/bemjax.com\/blog\/wp-json\/wp\/v2\/posts\/335","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/bemjax.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/bemjax.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/bemjax.com\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/bemjax.com\/blog\/wp-json\/wp\/v2\/comments?post=335"}],"version-history":[{"count":3,"href":"https:\/\/bemjax.com\/blog\/wp-json\/wp\/v2\/posts\/335\/revisions"}],"predecessor-version":[{"id":338,"href":"https:\/\/bemjax.com\/blog\/wp-json\/wp\/v2\/posts\/335\/revisions\/338"}],"wp:attachment":[{"href":"https:\/\/bemjax.com\/blog\/wp-json\/wp\/v2\/media?parent=335"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/bemjax.com\/blog\/wp-json\/wp\/v2\/categories?post=335"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/bemjax.com\/blog\/wp-json\/wp\/v2\/tags?post=335"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}