{"id":"arxiv:2609.00686","kind":"preprint","title":"A Study of Hidden-State Optimization Order in Predictive Coding Networks","authors":["Xueyuan Li","Danilo Vasconcellos Vargas"],"author_count":2,"year":2026,"published":"2026-09-01","venue":null,"cited_by":0,"doi":null,"arxiv_id":"2609.00686","nct_id":null,"source_url":"https://arxiv.org/abs/2609.00686","archive_url":"https://space-kitty.com/papers/arxiv:2609.00686","updated":"2026-09-01","pmid":null,"pmcid":null,"openalex_id":"W7206182060","pdf_url":"https://arxiv.org/pdf/2609.00686","abstract":"Local learning methods offer an alternative to end-to-end backpropagation, but their unstructured local objectives can produce weak feature learning in deep networks. We study whether the order of hidden-state optimization can address this limitation. We propose a boundary-first inference schedule that partitions a model into chunks, first coordinates hidden states at chunk boundaries, and then refines representations within each chunk. We instantiate this schedule in predictive coding networks (PCNs), a local-learning framework in which hidden activities and prediction errors are explicitly exposed during inference. On CIFAR-10, the resulting boundary-first predictive-coding instantiation improves accuracy over standard predictive coding by $9.77\\%$ under a standard parametrization and by $5.51\\%$ under a $μ$-parametrization. Diagnostic analyses further show more non-trivial early-layer updates, lower initial-to-final CKA, and more diverse layerwise gradients, consistent with stronger feature learning. These results support boundary-first, chunk-based inference as a practical design principle for predictive-coding training and motivate its study in broader local-learning systems.","abstract_license":"CC0-1.0 (arXiv descriptive metadata)","license":null,"is_open_access":false,"retracted":false,"peer_reviewed":false,"categories":["cs.LG","cs.AI"],"details":null,"provenance":"arxiv","attribution":"Abstract: arXiv descriptive metadata (CC0). Thank you to arXiv for use of its open access interoperability. This service was not reviewed or approved by, nor does it necessarily express or reflect the policies or opinions of, arXiv.","topics":[{"slug":"neuroai","name":"NeuroAI & Computational Neuroscience","domain_slug":"neuroscience"}],"cited_in_dossiers":[]}