projects / deliverable / binutils-gdb.git / blame
? search:
summary | shortlog | log | commit | commitdiff | tree
blob | blame (incremental) | history | HEAD
[AArch64][8/8] LD support BFD_RELOC_AARCH64_TLSLD_ADD_DTPREL_LO12
[deliverable/binutils-gdb.git] / bfd / elfnn-aarch64.c
CommitLineData
cec5225b 1/* AArch64-specific support for NN-bit ELF.
b90efa5b 2 Copyright (C) 2009-2015 Free Software Foundation, Inc.
a06ea964
NC		 3 Contributed by ARM Ltd.
4
5 This file is part of BFD, the Binary File Descriptor library.
6
7 This program is free software; you can redistribute it and/or modify
8 it under the terms of the GNU General Public License as published by
9 the Free Software Foundation; either version 3 of the License, or
10 (at your option) any later version.
11
12 This program is distributed in the hope that it will be useful,
13 but WITHOUT ANY WARRANTY; without even the implied warranty of
14 MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the
15 GNU General Public License for more details.
16
17 You should have received a copy of the GNU General Public License
18 along with this program; see the file COPYING3. If not,
19 see <http://www.gnu.org/licenses/>. */
20
21/* Notes on implementation:
22
23 Thread Local Store (TLS)
24
25 Overview:
26
27 The implementation currently supports both traditional TLS and TLS
28 descriptors, but only general dynamic (GD).
29
30 For traditional TLS the assembler will present us with code
31 fragments of the form:
32
33 adrp x0, :tlsgd:foo
34 R_AARCH64_TLSGD_ADR_PAGE21(foo)
35 add x0, :tlsgd_lo12:foo
36 R_AARCH64_TLSGD_ADD_LO12_NC(foo)
37 bl __tls_get_addr
38 nop
39
40 For TLS descriptors the assembler will present us with code
41 fragments of the form:
42
418009c2 43 adrp x0, :tlsdesc:foo R_AARCH64_TLSDESC_ADR_PAGE21(foo)
a06ea964
NC		 44 ldr x1, [x0, #:tlsdesc_lo12:foo] R_AARCH64_TLSDESC_LD64_LO12(foo)
45 add x0, x0, #:tlsdesc_lo12:foo R_AARCH64_TLSDESC_ADD_LO12(foo)
46 .tlsdesccall foo
47 blr x1 R_AARCH64_TLSDESC_CALL(foo)
48
49 The relocations R_AARCH64_TLSGD_{ADR_PREL21,ADD_LO12_NC} against foo
50 indicate that foo is thread local and should be accessed via the
51 traditional TLS mechanims.
52
a6bb11b2 53 The relocations R_AARCH64_TLSDESC_{ADR_PAGE21,LD64_LO12_NC,ADD_LO12_NC}
a06ea964
NC		 54 against foo indicate that 'foo' is thread local and should be accessed
55 via a TLS descriptor mechanism.
56
57 The precise instruction sequence is only relevant from the
58 perspective of linker relaxation which is currently not implemented.
59
60 The static linker must detect that 'foo' is a TLS object and
61 allocate a double GOT entry. The GOT entry must be created for both
62 global and local TLS symbols. Note that this is different to none
63 TLS local objects which do not need a GOT entry.
64
65 In the traditional TLS mechanism, the double GOT entry is used to
66 provide the tls_index structure, containing module and offset
a6bb11b2 67 entries. The static linker places the relocation R_AARCH64_TLS_DTPMOD
a06ea964
NC		 68 on the module entry. The loader will subsequently fixup this
69 relocation with the module identity.
70
71 For global traditional TLS symbols the static linker places an
a6bb11b2 72 R_AARCH64_TLS_DTPREL relocation on the offset entry. The loader
a06ea964
NC		 73 will subsequently fixup the offset. For local TLS symbols the static
74 linker fixes up offset.
75
76 In the TLS descriptor mechanism the double GOT entry is used to
77 provide the descriptor. The static linker places the relocation
78 R_AARCH64_TLSDESC on the first GOT slot. The loader will
79 subsequently fix this up.
80
81 Implementation:
82
83 The handling of TLS symbols is implemented across a number of
84 different backend functions. The following is a top level view of
85 what processing is performed where.
86
87 The TLS implementation maintains state information for each TLS
88 symbol. The state information for local and global symbols is kept
89 in different places. Global symbols use generic BFD structures while
90 local symbols use backend specific structures that are allocated and
91 maintained entirely by the backend.
92
93 The flow:
94
cec5225b 95 elfNN_aarch64_check_relocs()
a06ea964
NC		 96
97 This function is invoked for each relocation.
98
99 The TLS relocations R_AARCH64_TLSGD_{ADR_PREL21,ADD_LO12_NC} and
a6bb11b2 100 R_AARCH64_TLSDESC_{ADR_PAGE21,LD64_LO12_NC,ADD_LO12_NC} are
a06ea964
NC		 101 spotted. One time creation of local symbol data structures are
102 created when the first local symbol is seen.
103
104 The reference count for a symbol is incremented. The GOT type for
105 each symbol is marked as general dynamic.
106
cec5225b 107 elfNN_aarch64_allocate_dynrelocs ()
a06ea964
NC		 108
109 For each global with positive reference count we allocate a double
110 GOT slot. For a traditional TLS symbol we allocate space for two
111 relocation entries on the GOT, for a TLS descriptor symbol we
112 allocate space for one relocation on the slot. Record the GOT offset
113 for this symbol.
114
cec5225b 115 elfNN_aarch64_size_dynamic_sections ()
a06ea964
NC		 116
117 Iterate all input BFDS, look for in the local symbol data structure
118 constructed earlier for local TLS symbols and allocate them double
119 GOT slots along with space for a single GOT relocation. Update the
120 local symbol structure to record the GOT offset allocated.
121
cec5225b 122 elfNN_aarch64_relocate_section ()
a06ea964 123
cec5225b 124 Calls elfNN_aarch64_final_link_relocate ()
a06ea964
NC		 125
126 Emit the relevant TLS relocations against the GOT for each TLS
127 symbol. For local TLS symbols emit the GOT offset directly. The GOT
128 relocations are emitted once the first time a TLS symbol is
129 encountered. The implementation uses the LSB of the GOT offset to
130 flag that the relevant GOT relocations for a symbol have been
131 emitted. All of the TLS code that uses the GOT offset needs to take
132 care to mask out this flag bit before using the offset.
133
cec5225b 134 elfNN_aarch64_final_link_relocate ()
a06ea964
NC		 135
136 Fixup the R_AARCH64_TLSGD_{ADR_PREL21, ADD_LO12_NC} relocations. */
137
138#include "sysdep.h"
139#include "bfd.h"
140#include "libiberty.h"
141#include "libbfd.h"
142#include "bfd_stdint.h"
143#include "elf-bfd.h"
144#include "bfdlink.h"
1419bbe5 145#include "objalloc.h"
a06ea964 146#include "elf/aarch64.h"
caed7120 147#include "elfxx-aarch64.h"
a06ea964 148
cec5225b
YZ		 149#define ARCH_SIZE NN
150
151#if ARCH_SIZE == 64
152#define AARCH64_R(NAME) R_AARCH64_ ## NAME
153#define AARCH64_R_STR(NAME) "R_AARCH64_" #NAME
a6bb11b2
YZ		 154#define HOWTO64(...) HOWTO (__VA_ARGS__)
155#define HOWTO32(...) EMPTY_HOWTO (0)
cec5225b
YZ		 156#define LOG_FILE_ALIGN 3
157#endif
158
159#if ARCH_SIZE == 32
160#define AARCH64_R(NAME) R_AARCH64_P32_ ## NAME
161#define AARCH64_R_STR(NAME) "R_AARCH64_P32_" #NAME
a6bb11b2
YZ		 162#define HOWTO64(...) EMPTY_HOWTO (0)
163#define HOWTO32(...) HOWTO (__VA_ARGS__)
cec5225b
YZ		 164#define LOG_FILE_ALIGN 2
165#endif
166
a6bb11b2 167#define IS_AARCH64_TLS_RELOC(R_TYPE) \
4c0a9a6f
JW		 168 ((R_TYPE) == BFD_RELOC_AARCH64_TLSGD_ADD_LO12_NC \
169 || (R_TYPE) == BFD_RELOC_AARCH64_TLSGD_ADR_PAGE21 \
3c12b054 170 || (R_TYPE) == BFD_RELOC_AARCH64_TLSGD_ADR_PREL21 \
a6bb11b2 171 || (R_TYPE) == BFD_RELOC_AARCH64_TLSIE_ADR_GOTTPREL_PAGE21 \
a6bb11b2 172 || (R_TYPE) == BFD_RELOC_AARCH64_TLSIE_LD32_GOTTPREL_LO12_NC \
4c0a9a6f 173 || (R_TYPE) == BFD_RELOC_AARCH64_TLSIE_LD64_GOTTPREL_LO12_NC \
a6bb11b2 174 || (R_TYPE) == BFD_RELOC_AARCH64_TLSIE_LD_GOTTPREL_PREL19 \
4c0a9a6f
JW		 175 || (R_TYPE) == BFD_RELOC_AARCH64_TLSIE_MOVW_GOTTPREL_G0_NC \
176 || (R_TYPE) == BFD_RELOC_AARCH64_TLSIE_MOVW_GOTTPREL_G1 \
40fbed84 177 || (R_TYPE) == BFD_RELOC_AARCH64_TLSLD_ADD_DTPREL_LO12 \
73f925cc 178 || (R_TYPE) == BFD_RELOC_AARCH64_TLSLD_ADD_LO12_NC \
f69e4920 179 || (R_TYPE) == BFD_RELOC_AARCH64_TLSLD_ADR_PAGE21 \
77a69ff8 180 || (R_TYPE) == BFD_RELOC_AARCH64_TLSLD_ADR_PREL21 \
a6bb11b2 181 || (R_TYPE) == BFD_RELOC_AARCH64_TLSLE_ADD_TPREL_HI12 \
4c0a9a6f 182 || (R_TYPE) == BFD_RELOC_AARCH64_TLSLE_ADD_TPREL_LO12 \
a6bb11b2 183 || (R_TYPE) == BFD_RELOC_AARCH64_TLSLE_ADD_TPREL_LO12_NC \
a6bb11b2
YZ		 184 || (R_TYPE) == BFD_RELOC_AARCH64_TLSLE_MOVW_TPREL_G0 \
185 || (R_TYPE) == BFD_RELOC_AARCH64_TLSLE_MOVW_TPREL_G0_NC \
4c0a9a6f
JW		 186 || (R_TYPE) == BFD_RELOC_AARCH64_TLSLE_MOVW_TPREL_G1 \
187 || (R_TYPE) == BFD_RELOC_AARCH64_TLSLE_MOVW_TPREL_G1_NC \
188 || (R_TYPE) == BFD_RELOC_AARCH64_TLSLE_MOVW_TPREL_G2 \
a6bb11b2
YZ		 189 || (R_TYPE) == BFD_RELOC_AARCH64_TLS_DTPMOD \
190 || (R_TYPE) == BFD_RELOC_AARCH64_TLS_DTPREL \
191 || (R_TYPE) == BFD_RELOC_AARCH64_TLS_TPREL \
a06ea964
NC		 192 || IS_AARCH64_TLSDESC_RELOC ((R_TYPE)))
193
a6bb11b2 194#define IS_AARCH64_TLSDESC_RELOC(R_TYPE) \
4c0a9a6f
JW		 195 ((R_TYPE) == BFD_RELOC_AARCH64_TLSDESC \
196 || (R_TYPE) == BFD_RELOC_AARCH64_TLSDESC_ADD \
197 || (R_TYPE) == BFD_RELOC_AARCH64_TLSDESC_ADD_LO12_NC \
a6bb11b2 198 || (R_TYPE) == BFD_RELOC_AARCH64_TLSDESC_ADR_PAGE21 \
389b8029 199 || (R_TYPE) == BFD_RELOC_AARCH64_TLSDESC_ADR_PREL21 \
4c0a9a6f 200 || (R_TYPE) == BFD_RELOC_AARCH64_TLSDESC_CALL \
a6bb11b2 201 || (R_TYPE) == BFD_RELOC_AARCH64_TLSDESC_LD32_LO12_NC \
4c0a9a6f 202 || (R_TYPE) == BFD_RELOC_AARCH64_TLSDESC_LD64_LO12_NC \
a6bb11b2 203 || (R_TYPE) == BFD_RELOC_AARCH64_TLSDESC_LDR \
4c0a9a6f
JW		 204 || (R_TYPE) == BFD_RELOC_AARCH64_TLSDESC_LD_PREL19 \
205 || (R_TYPE) == BFD_RELOC_AARCH64_TLSDESC_OFF_G0_NC \
206 || (R_TYPE) == BFD_RELOC_AARCH64_TLSDESC_OFF_G1)
a06ea964
NC		 207
208#define ELIMINATE_COPY_RELOCS 0
209
a06ea964 210/* Return size of a relocation entry. HTAB is the bfd's
cec5225b
YZ		 211 elf_aarch64_link_hash_entry. */
212#define RELOC_SIZE(HTAB) (sizeof (ElfNN_External_Rela))
a06ea964 213
cec5225b
YZ		 214/* GOT Entry size - 8 bytes in ELF64 and 4 bytes in ELF32. */
215#define GOT_ENTRY_SIZE (ARCH_SIZE / 8)
a06ea964
NC		 216#define PLT_ENTRY_SIZE (32)
217#define PLT_SMALL_ENTRY_SIZE (16)
218#define PLT_TLSDESC_ENTRY_SIZE (32)
219
a06ea964
NC		 220/* Encoding of the nop instruction */
221#define INSN_NOP 0xd503201f
222
223#define aarch64_compute_jump_table_size(htab) \
224 (((htab)->root.srelplt == NULL) ? 0 \
225 : (htab)->root.srelplt->reloc_count * GOT_ENTRY_SIZE)
226
227/* The first entry in a procedure linkage table looks like this
228 if the distance between the PLTGOT and the PLT is < 4GB use
229 these PLT entries. Note that the dynamic linker gets &PLTGOT[2]
230 in x16 and needs to work out PLTGOT[1] by using an address of
cec5225b
YZ		 231 [x16,#-GOT_ENTRY_SIZE]. */
232static const bfd_byte elfNN_aarch64_small_plt0_entry[PLT_ENTRY_SIZE] =
a06ea964
NC		 233{
234 0xf0, 0x7b, 0xbf, 0xa9, /* stp x16, x30, [sp, #-16]! */
235 0x10, 0x00, 0x00, 0x90, /* adrp x16, (GOT+16) */
caed7120 236#if ARCH_SIZE == 64
a06ea964
NC		 237 0x11, 0x0A, 0x40, 0xf9, /* ldr x17, [x16, #PLT_GOT+0x10] */
238 0x10, 0x42, 0x00, 0x91, /* add x16, x16,#PLT_GOT+0x10 */
caed7120
YZ		 239#else
240 0x11, 0x0A, 0x40, 0xb9, /* ldr w17, [x16, #PLT_GOT+0x8] */
241 0x10, 0x22, 0x00, 0x11, /* add w16, w16,#PLT_GOT+0x8 */
242#endif
a06ea964
NC		 243 0x20, 0x02, 0x1f, 0xd6, /* br x17 */
244 0x1f, 0x20, 0x03, 0xd5, /* nop */
245 0x1f, 0x20, 0x03, 0xd5, /* nop */
246 0x1f, 0x20, 0x03, 0xd5, /* nop */
247};
248
249/* Per function entry in a procedure linkage table looks like this
250 if the distance between the PLTGOT and the PLT is < 4GB use
251 these PLT entries. */
cec5225b 252static const bfd_byte elfNN_aarch64_small_plt_entry[PLT_SMALL_ENTRY_SIZE] =
a06ea964
NC		 253{
254 0x10, 0x00, 0x00, 0x90, /* adrp x16, PLTGOT + n * 8 */
caed7120 255#if ARCH_SIZE == 64
a06ea964
NC		 256 0x11, 0x02, 0x40, 0xf9, /* ldr x17, [x16, PLTGOT + n * 8] */
257 0x10, 0x02, 0x00, 0x91, /* add x16, x16, :lo12:PLTGOT + n * 8 */
caed7120
YZ		 258#else
259 0x11, 0x02, 0x40, 0xb9, /* ldr w17, [x16, PLTGOT + n * 4] */
260 0x10, 0x02, 0x00, 0x11, /* add w16, w16, :lo12:PLTGOT + n * 4 */
261#endif
a06ea964
NC		 262 0x20, 0x02, 0x1f, 0xd6, /* br x17. */
263};
264
265static const bfd_byte
cec5225b 266elfNN_aarch64_tlsdesc_small_plt_entry[PLT_TLSDESC_ENTRY_SIZE] =
a06ea964
NC		 267{
268 0xe2, 0x0f, 0xbf, 0xa9, /* stp x2, x3, [sp, #-16]! */
269 0x02, 0x00, 0x00, 0x90, /* adrp x2, 0 */
270 0x03, 0x00, 0x00, 0x90, /* adrp x3, 0 */
caed7120
YZ		 271#if ARCH_SIZE == 64
272 0x42, 0x00, 0x40, 0xf9, /* ldr x2, [x2, #0] */
a06ea964 273 0x63, 0x00, 0x00, 0x91, /* add x3, x3, 0 */
caed7120
YZ		 274#else
275 0x42, 0x00, 0x40, 0xb9, /* ldr w2, [x2, #0] */
276 0x63, 0x00, 0x00, 0x11, /* add w3, w3, 0 */
277#endif
278 0x40, 0x00, 0x1f, 0xd6, /* br x2 */
a06ea964
NC		 279 0x1f, 0x20, 0x03, 0xd5, /* nop */
280 0x1f, 0x20, 0x03, 0xd5, /* nop */
281};
282
cec5225b
YZ		 283#define elf_info_to_howto elfNN_aarch64_info_to_howto
284#define elf_info_to_howto_rel elfNN_aarch64_info_to_howto
a06ea964
NC		 285
286#define AARCH64_ELF_ABI_VERSION 0
a06ea964
NC		 287
288/* In case we're on a 32-bit machine, construct a 64-bit "-1" value. */
289#define ALL_ONES (~ (bfd_vma) 0)
290
a6bb11b2
YZ		 291/* Indexed by the bfd interal reloc enumerators.
292 Therefore, the table needs to be synced with BFD_RELOC_AARCH64_*
293 in reloc.c. */
a06ea964 294
a6bb11b2 295static reloc_howto_type elfNN_aarch64_howto_table[] =
a06ea964 296{
a6bb11b2 297 EMPTY_HOWTO (0),
a06ea964 298
a6bb11b2 299 /* Basic data relocations. */
a06ea964 300
a6bb11b2
YZ		 301#if ARCH_SIZE == 64
302 HOWTO (R_AARCH64_NULL, /* type */
a06ea964 303 0, /* rightshift */
6346d5ca 304 3, /* size (0 = byte, 1 = short, 2 = long) */
a6bb11b2 305 0, /* bitsize */
a06ea964
NC		 306 FALSE, /* pc_relative */
307 0, /* bitpos */
308 complain_overflow_dont, /* complain_on_overflow */
309 bfd_elf_generic_reloc, /* special_function */
a6bb11b2 310 "R_AARCH64_NULL", /* name */
a06ea964
NC		 311 FALSE, /* partial_inplace */
312 0, /* src_mask */
a6bb11b2 313 0, /* dst_mask */
a06ea964 314 FALSE), /* pcrel_offset */
a6bb11b2
YZ		 315#else
316 HOWTO (R_AARCH64_NONE, /* type */
a06ea964 317 0, /* rightshift */
6346d5ca 318 3, /* size (0 = byte, 1 = short, 2 = long) */
a06ea964
NC		 319 0, /* bitsize */
320 FALSE, /* pc_relative */
321 0, /* bitpos */
322 complain_overflow_dont, /* complain_on_overflow */
323 bfd_elf_generic_reloc, /* special_function */
a6bb11b2 324 "R_AARCH64_NONE", /* name */
a06ea964
NC		 325 FALSE, /* partial_inplace */
326 0, /* src_mask */
327 0, /* dst_mask */
328 FALSE), /* pcrel_offset */
a6bb11b2 329#endif
a06ea964
NC		 330
331 /* .xword: (S+A) */
a6bb11b2 332 HOWTO64 (AARCH64_R (ABS64), /* type */
a06ea964
NC		 333 0, /* rightshift */
334 4, /* size (4 = long long) */
335 64, /* bitsize */
336 FALSE, /* pc_relative */
337 0, /* bitpos */
338 complain_overflow_unsigned, /* complain_on_overflow */
339 bfd_elf_generic_reloc, /* special_function */
a6bb11b2 340 AARCH64_R_STR (ABS64), /* name */
a06ea964
NC		 341 FALSE, /* partial_inplace */
342 ALL_ONES, /* src_mask */
343 ALL_ONES, /* dst_mask */
344 FALSE), /* pcrel_offset */
345
346 /* .word: (S+A) */
a6bb11b2 347 HOWTO (AARCH64_R (ABS32), /* type */
a06ea964
NC		 348 0, /* rightshift */
349 2, /* size (0 = byte, 1 = short, 2 = long) */
350 32, /* bitsize */
351 FALSE, /* pc_relative */
352 0, /* bitpos */
353 complain_overflow_unsigned, /* complain_on_overflow */
354 bfd_elf_generic_reloc, /* special_function */
a6bb11b2 355 AARCH64_R_STR (ABS32), /* name */
a06ea964
NC		 356 FALSE, /* partial_inplace */
357 0xffffffff, /* src_mask */
358 0xffffffff, /* dst_mask */
359 FALSE), /* pcrel_offset */
360
361 /* .half: (S+A) */
a6bb11b2 362 HOWTO (AARCH64_R (ABS16), /* type */
a06ea964
NC		 363 0, /* rightshift */
364 1, /* size (0 = byte, 1 = short, 2 = long) */
365 16, /* bitsize */
366 FALSE, /* pc_relative */
367 0, /* bitpos */
368 complain_overflow_unsigned, /* complain_on_overflow */
369 bfd_elf_generic_reloc, /* special_function */
a6bb11b2 370 AARCH64_R_STR (ABS16), /* name */
a06ea964
NC		 371 FALSE, /* partial_inplace */
372 0xffff, /* src_mask */
373 0xffff, /* dst_mask */
374 FALSE), /* pcrel_offset */
375
376 /* .xword: (S+A-P) */
a6bb11b2 377 HOWTO64 (AARCH64_R (PREL64), /* type */
a06ea964
NC		 378 0, /* rightshift */
379 4, /* size (4 = long long) */
380 64, /* bitsize */
381 TRUE, /* pc_relative */
382 0, /* bitpos */
383 complain_overflow_signed, /* complain_on_overflow */
384 bfd_elf_generic_reloc, /* special_function */
a6bb11b2 385 AARCH64_R_STR (PREL64), /* name */
a06ea964
NC		 386 FALSE, /* partial_inplace */
387 ALL_ONES, /* src_mask */
388 ALL_ONES, /* dst_mask */
389 TRUE), /* pcrel_offset */
390
391 /* .word: (S+A-P) */
a6bb11b2 392 HOWTO (AARCH64_R (PREL32), /* type */
a06ea964
NC		 393 0, /* rightshift */
394 2, /* size (0 = byte, 1 = short, 2 = long) */
395 32, /* bitsize */
396 TRUE, /* pc_relative */
397 0, /* bitpos */
398 complain_overflow_signed, /* complain_on_overflow */
399 bfd_elf_generic_reloc, /* special_function */
a6bb11b2 400 AARCH64_R_STR (PREL32), /* name */
a06ea964
NC		 401 FALSE, /* partial_inplace */
402 0xffffffff, /* src_mask */
403 0xffffffff, /* dst_mask */
404 TRUE), /* pcrel_offset */
405
406 /* .half: (S+A-P) */
a6bb11b2 407 HOWTO (AARCH64_R (PREL16), /* type */
a06ea964
NC		 408 0, /* rightshift */
409 1, /* size (0 = byte, 1 = short, 2 = long) */
410 16, /* bitsize */
411 TRUE, /* pc_relative */
412 0, /* bitpos */
413 complain_overflow_signed, /* complain_on_overflow */
414 bfd_elf_generic_reloc, /* special_function */
a6bb11b2 415 AARCH64_R_STR (PREL16), /* name */
a06ea964
NC		 416 FALSE, /* partial_inplace */
417 0xffff, /* src_mask */
418 0xffff, /* dst_mask */
419 TRUE), /* pcrel_offset */
420
421 /* Group relocations to create a 16, 32, 48 or 64 bit
422 unsigned data or abs address inline. */
423
424 /* MOVZ: ((S+A) >> 0) & 0xffff */
a6bb11b2 425 HOWTO (AARCH64_R (MOVW_UABS_G0), /* type */
a06ea964
NC		 426 0, /* rightshift */
427 2, /* size (0 = byte, 1 = short, 2 = long) */
428 16, /* bitsize */
429 FALSE, /* pc_relative */
430 0, /* bitpos */
431 complain_overflow_unsigned, /* complain_on_overflow */
432 bfd_elf_generic_reloc, /* special_function */
a6bb11b2 433 AARCH64_R_STR (MOVW_UABS_G0), /* name */
a06ea964
NC		 434 FALSE, /* partial_inplace */
435 0xffff, /* src_mask */
436 0xffff, /* dst_mask */
437 FALSE), /* pcrel_offset */
438
439 /* MOVK: ((S+A) >> 0) & 0xffff [no overflow check] */
a6bb11b2 440 HOWTO (AARCH64_R (MOVW_UABS_G0_NC), /* type */
a06ea964
NC		 441 0, /* rightshift */
442 2, /* size (0 = byte, 1 = short, 2 = long) */
443 16, /* bitsize */
444 FALSE, /* pc_relative */
445 0, /* bitpos */
446 complain_overflow_dont, /* complain_on_overflow */
447 bfd_elf_generic_reloc, /* special_function */
a6bb11b2 448 AARCH64_R_STR (MOVW_UABS_G0_NC), /* name */
a06ea964
NC		 449 FALSE, /* partial_inplace */
450 0xffff, /* src_mask */
451 0xffff, /* dst_mask */
452 FALSE), /* pcrel_offset */
453
454 /* MOVZ: ((S+A) >> 16) & 0xffff */
a6bb11b2 455 HOWTO (AARCH64_R (MOVW_UABS_G1), /* type */
a06ea964
NC		 456 16, /* rightshift */
457 2, /* size (0 = byte, 1 = short, 2 = long) */
458 16, /* bitsize */
459 FALSE, /* pc_relative */
460 0, /* bitpos */
461 complain_overflow_unsigned, /* complain_on_overflow */
462 bfd_elf_generic_reloc, /* special_function */
a6bb11b2 463 AARCH64_R_STR (MOVW_UABS_G1), /* name */
a06ea964
NC		 464 FALSE, /* partial_inplace */
465 0xffff, /* src_mask */
466 0xffff, /* dst_mask */
467 FALSE), /* pcrel_offset */
468
469 /* MOVK: ((S+A) >> 16) & 0xffff [no overflow check] */
a6bb11b2 470 HOWTO64 (AARCH64_R (MOVW_UABS_G1_NC), /* type */
a06ea964
NC		 471 16, /* rightshift */
472 2, /* size (0 = byte, 1 = short, 2 = long) */
473 16, /* bitsize */
474 FALSE, /* pc_relative */
475 0, /* bitpos */
476 complain_overflow_dont, /* complain_on_overflow */
477 bfd_elf_generic_reloc, /* special_function */
a6bb11b2 478 AARCH64_R_STR (MOVW_UABS_G1_NC), /* name */
a06ea964
NC		 479 FALSE, /* partial_inplace */
480 0xffff, /* src_mask */
481 0xffff, /* dst_mask */
482 FALSE), /* pcrel_offset */
483
484 /* MOVZ: ((S+A) >> 32) & 0xffff */
a6bb11b2 485 HOWTO64 (AARCH64_R (MOVW_UABS_G2), /* type */
a06ea964
NC		 486 32, /* rightshift */
487 2, /* size (0 = byte, 1 = short, 2 = long) */
488 16, /* bitsize */
489 FALSE, /* pc_relative */
490 0, /* bitpos */
491 complain_overflow_unsigned, /* complain_on_overflow */
492 bfd_elf_generic_reloc, /* special_function */
a6bb11b2 493 AARCH64_R_STR (MOVW_UABS_G2), /* name */
a06ea964
NC		 494 FALSE, /* partial_inplace */
495 0xffff, /* src_mask */
496 0xffff, /* dst_mask */
497 FALSE), /* pcrel_offset */
498
499 /* MOVK: ((S+A) >> 32) & 0xffff [no overflow check] */
a6bb11b2 500 HOWTO64 (AARCH64_R (MOVW_UABS_G2_NC), /* type */
a06ea964
NC		 501 32, /* rightshift */
502 2, /* size (0 = byte, 1 = short, 2 = long) */
503 16, /* bitsize */
504 FALSE, /* pc_relative */
505 0, /* bitpos */
506 complain_overflow_dont, /* complain_on_overflow */
507 bfd_elf_generic_reloc, /* special_function */
a6bb11b2 508 AARCH64_R_STR (MOVW_UABS_G2_NC), /* name */
a06ea964
NC		 509 FALSE, /* partial_inplace */
510 0xffff, /* src_mask */
511 0xffff, /* dst_mask */
512 FALSE), /* pcrel_offset */
513
514 /* MOVZ: ((S+A) >> 48) & 0xffff */
a6bb11b2 515 HOWTO64 (AARCH64_R (MOVW_UABS_G3), /* type */
a06ea964
NC		 516 48, /* rightshift */
517 2, /* size (0 = byte, 1 = short, 2 = long) */
518 16, /* bitsize */
519 FALSE, /* pc_relative */
520 0, /* bitpos */
521 complain_overflow_unsigned, /* complain_on_overflow */
522 bfd_elf_generic_reloc, /* special_function */
a6bb11b2 523 AARCH64_R_STR (MOVW_UABS_G3), /* name */
a06ea964
NC		 524 FALSE, /* partial_inplace */
525 0xffff, /* src_mask */
526 0xffff, /* dst_mask */
527 FALSE), /* pcrel_offset */
528
529 /* Group relocations to create high part of a 16, 32, 48 or 64 bit
530 signed data or abs address inline. Will change instruction
531 to MOVN or MOVZ depending on sign of calculated value. */
532
533 /* MOV[ZN]: ((S+A) >> 0) & 0xffff */
a6bb11b2 534 HOWTO (AARCH64_R (MOVW_SABS_G0), /* type */
a06ea964
NC		 535 0, /* rightshift */
536 2, /* size (0 = byte, 1 = short, 2 = long) */
537 16, /* bitsize */
538 FALSE, /* pc_relative */
539 0, /* bitpos */
540 complain_overflow_signed, /* complain_on_overflow */
541 bfd_elf_generic_reloc, /* special_function */
a6bb11b2 542 AARCH64_R_STR (MOVW_SABS_G0), /* name */
a06ea964
NC		 543 FALSE, /* partial_inplace */
544 0xffff, /* src_mask */
545 0xffff, /* dst_mask */
546 FALSE), /* pcrel_offset */
547
548 /* MOV[ZN]: ((S+A) >> 16) & 0xffff */
a6bb11b2 549 HOWTO64 (AARCH64_R (MOVW_SABS_G1), /* type */
a06ea964
NC		 550 16, /* rightshift */
551 2, /* size (0 = byte, 1 = short, 2 = long) */
552 16, /* bitsize */
553 FALSE, /* pc_relative */
554 0, /* bitpos */
555 complain_overflow_signed, /* complain_on_overflow */
556 bfd_elf_generic_reloc, /* special_function */
a6bb11b2 557 AARCH64_R_STR (MOVW_SABS_G1), /* name */
a06ea964
NC		 558 FALSE, /* partial_inplace */
559 0xffff, /* src_mask */
560 0xffff, /* dst_mask */
561 FALSE), /* pcrel_offset */
562
563 /* MOV[ZN]: ((S+A) >> 32) & 0xffff */
a6bb11b2 564 HOWTO64 (AARCH64_R (MOVW_SABS_G2), /* type */
a06ea964
NC		 565 32, /* rightshift */
566 2, /* size (0 = byte, 1 = short, 2 = long) */
567 16, /* bitsize */
568 FALSE, /* pc_relative */
569 0, /* bitpos */
570 complain_overflow_signed, /* complain_on_overflow */
571 bfd_elf_generic_reloc, /* special_function */
a6bb11b2 572 AARCH64_R_STR (MOVW_SABS_G2), /* name */
a06ea964
NC		 573 FALSE, /* partial_inplace */
574 0xffff, /* src_mask */
575 0xffff, /* dst_mask */
576 FALSE), /* pcrel_offset */
577
578/* Relocations to generate 19, 21 and 33 bit PC-relative load/store
579 addresses: PG(x) is (x & ~0xfff). */
580
581 /* LD-lit: ((S+A-P) >> 2) & 0x7ffff */
a6bb11b2 582 HOWTO (AARCH64_R (LD_PREL_LO19), /* type */
a06ea964
NC		 583 2, /* rightshift */
584 2, /* size (0 = byte, 1 = short, 2 = long) */
585 19, /* bitsize */
586 TRUE, /* pc_relative */
587 0, /* bitpos */
588 complain_overflow_signed, /* complain_on_overflow */
589 bfd_elf_generic_reloc, /* special_function */
a6bb11b2 590 AARCH64_R_STR (LD_PREL_LO19), /* name */
a06ea964
NC		 591 FALSE, /* partial_inplace */
592 0x7ffff, /* src_mask */
593 0x7ffff, /* dst_mask */
594 TRUE), /* pcrel_offset */
595
596 /* ADR: (S+A-P) & 0x1fffff */
a6bb11b2 597 HOWTO (AARCH64_R (ADR_PREL_LO21), /* type */
a06ea964
NC		 598 0, /* rightshift */
599 2, /* size (0 = byte, 1 = short, 2 = long) */
600 21, /* bitsize */
601 TRUE, /* pc_relative */
602 0, /* bitpos */
603 complain_overflow_signed, /* complain_on_overflow */
604 bfd_elf_generic_reloc, /* special_function */
a6bb11b2 605 AARCH64_R_STR (ADR_PREL_LO21), /* name */
a06ea964
NC		 606 FALSE, /* partial_inplace */
607 0x1fffff, /* src_mask */
608 0x1fffff, /* dst_mask */
609 TRUE), /* pcrel_offset */
610
611 /* ADRP: ((PG(S+A)-PG(P)) >> 12) & 0x1fffff */
a6bb11b2 612 HOWTO (AARCH64_R (ADR_PREL_PG_HI21), /* type */
a06ea964
NC		 613 12, /* rightshift */
614 2, /* size (0 = byte, 1 = short, 2 = long) */
615 21, /* bitsize */
616 TRUE, /* pc_relative */
617 0, /* bitpos */
618 complain_overflow_signed, /* complain_on_overflow */
619 bfd_elf_generic_reloc, /* special_function */
a6bb11b2 620 AARCH64_R_STR (ADR_PREL_PG_HI21), /* name */
a06ea964
NC		 621 FALSE, /* partial_inplace */
622 0x1fffff, /* src_mask */
623 0x1fffff, /* dst_mask */
624 TRUE), /* pcrel_offset */
625
626 /* ADRP: ((PG(S+A)-PG(P)) >> 12) & 0x1fffff [no overflow check] */
a6bb11b2 627 HOWTO64 (AARCH64_R (ADR_PREL_PG_HI21_NC), /* type */
a06ea964
NC		 628 12, /* rightshift */
629 2, /* size (0 = byte, 1 = short, 2 = long) */
630 21, /* bitsize */
631 TRUE, /* pc_relative */
632 0, /* bitpos */
633 complain_overflow_dont, /* complain_on_overflow */
634 bfd_elf_generic_reloc, /* special_function */
a6bb11b2 635 AARCH64_R_STR (ADR_PREL_PG_HI21_NC), /* name */
a06ea964
NC		 636 FALSE, /* partial_inplace */
637 0x1fffff, /* src_mask */
638 0x1fffff, /* dst_mask */
639 TRUE), /* pcrel_offset */
640
641 /* ADD: (S+A) & 0xfff [no overflow check] */
a6bb11b2 642 HOWTO (AARCH64_R (ADD_ABS_LO12_NC), /* type */
a06ea964
NC		 643 0, /* rightshift */
644 2, /* size (0 = byte, 1 = short, 2 = long) */
645 12, /* bitsize */
646 FALSE, /* pc_relative */
647 10, /* bitpos */
648 complain_overflow_dont, /* complain_on_overflow */
649 bfd_elf_generic_reloc, /* special_function */
a6bb11b2 650 AARCH64_R_STR (ADD_ABS_LO12_NC), /* name */
a06ea964
NC		 651 FALSE, /* partial_inplace */
652 0x3ffc00, /* src_mask */
653 0x3ffc00, /* dst_mask */
654 FALSE), /* pcrel_offset */
655
656 /* LD/ST8: (S+A) & 0xfff */
a6bb11b2 657 HOWTO (AARCH64_R (LDST8_ABS_LO12_NC), /* type */
a06ea964
NC		 658 0, /* rightshift */
659 2, /* size (0 = byte, 1 = short, 2 = long) */
660 12, /* bitsize */
661 FALSE, /* pc_relative */
662 0, /* bitpos */
663 complain_overflow_dont, /* complain_on_overflow */
664 bfd_elf_generic_reloc, /* special_function */
a6bb11b2 665 AARCH64_R_STR (LDST8_ABS_LO12_NC), /* name */
a06ea964
NC		 666 FALSE, /* partial_inplace */
667 0xfff, /* src_mask */
668 0xfff, /* dst_mask */
669 FALSE), /* pcrel_offset */
670
671 /* Relocations for control-flow instructions. */
672
673 /* TBZ/NZ: ((S+A-P) >> 2) & 0x3fff */
a6bb11b2 674 HOWTO (AARCH64_R (TSTBR14), /* type */
a06ea964
NC		 675 2, /* rightshift */
676 2, /* size (0 = byte, 1 = short, 2 = long) */
677 14, /* bitsize */
678 TRUE, /* pc_relative */
679 0, /* bitpos */
680 complain_overflow_signed, /* complain_on_overflow */
681 bfd_elf_generic_reloc, /* special_function */
a6bb11b2 682 AARCH64_R_STR (TSTBR14), /* name */
a06ea964
NC		 683 FALSE, /* partial_inplace */
684 0x3fff, /* src_mask */
685 0x3fff, /* dst_mask */
686 TRUE), /* pcrel_offset */
687
688 /* B.cond: ((S+A-P) >> 2) & 0x7ffff */
a6bb11b2 689 HOWTO (AARCH64_R (CONDBR19), /* type */
a06ea964
NC		 690 2, /* rightshift */
691 2, /* size (0 = byte, 1 = short, 2 = long) */
692 19, /* bitsize */
693 TRUE, /* pc_relative */
694 0, /* bitpos */
695 complain_overflow_signed, /* complain_on_overflow */
696 bfd_elf_generic_reloc, /* special_function */
a6bb11b2 697 AARCH64_R_STR (CONDBR19), /* name */
a06ea964
NC		 698 FALSE, /* partial_inplace */
699 0x7ffff, /* src_mask */
700 0x7ffff, /* dst_mask */
701 TRUE), /* pcrel_offset */
702
a06ea964 703 /* B: ((S+A-P) >> 2) & 0x3ffffff */
a6bb11b2 704 HOWTO (AARCH64_R (JUMP26), /* type */
a06ea964
NC		 705 2, /* rightshift */
706 2, /* size (0 = byte, 1 = short, 2 = long) */
707 26, /* bitsize */
708 TRUE, /* pc_relative */
709 0, /* bitpos */
710 complain_overflow_signed, /* complain_on_overflow */
711 bfd_elf_generic_reloc, /* special_function */
a6bb11b2 712 AARCH64_R_STR (JUMP26), /* name */
a06ea964
NC		 713 FALSE, /* partial_inplace */
714 0x3ffffff, /* src_mask */
715 0x3ffffff, /* dst_mask */
716 TRUE), /* pcrel_offset */
717
718 /* BL: ((S+A-P) >> 2) & 0x3ffffff */
a6bb11b2 719 HOWTO (AARCH64_R (CALL26), /* type */
a06ea964
NC		 720 2, /* rightshift */
721 2, /* size (0 = byte, 1 = short, 2 = long) */
722 26, /* bitsize */
723 TRUE, /* pc_relative */
724 0, /* bitpos */
725 complain_overflow_signed, /* complain_on_overflow */
726 bfd_elf_generic_reloc, /* special_function */
a6bb11b2 727 AARCH64_R_STR (CALL26), /* name */
a06ea964
NC		 728 FALSE, /* partial_inplace */
729 0x3ffffff, /* src_mask */
730 0x3ffffff, /* dst_mask */
731 TRUE), /* pcrel_offset */
732
733 /* LD/ST16: (S+A) & 0xffe */
a6bb11b2 734 HOWTO (AARCH64_R (LDST16_ABS_LO12_NC), /* type */
a06ea964
NC		 735 1, /* rightshift */
736 2, /* size (0 = byte, 1 = short, 2 = long) */
737 12, /* bitsize */
738 FALSE, /* pc_relative */
739 0, /* bitpos */
740 complain_overflow_dont, /* complain_on_overflow */
741 bfd_elf_generic_reloc, /* special_function */
a6bb11b2 742 AARCH64_R_STR (LDST16_ABS_LO12_NC), /* name */
a06ea964
NC		 743 FALSE, /* partial_inplace */
744 0xffe, /* src_mask */
745 0xffe, /* dst_mask */
746 FALSE), /* pcrel_offset */
747
748 /* LD/ST32: (S+A) & 0xffc */
a6bb11b2 749 HOWTO (AARCH64_R (LDST32_ABS_LO12_NC), /* type */
a06ea964
NC		 750 2, /* rightshift */
751 2, /* size (0 = byte, 1 = short, 2 = long) */
752 12, /* bitsize */
753 FALSE, /* pc_relative */
754 0, /* bitpos */
755 complain_overflow_dont, /* complain_on_overflow */
756 bfd_elf_generic_reloc, /* special_function */
a6bb11b2 757 AARCH64_R_STR (LDST32_ABS_LO12_NC), /* name */
a06ea964
NC		 758 FALSE, /* partial_inplace */
759 0xffc, /* src_mask */
760 0xffc, /* dst_mask */
761 FALSE), /* pcrel_offset */
762
763 /* LD/ST64: (S+A) & 0xff8 */
a6bb11b2 764 HOWTO (AARCH64_R (LDST64_ABS_LO12_NC), /* type */
a06ea964
NC		 765 3, /* rightshift */
766 2, /* size (0 = byte, 1 = short, 2 = long) */
767 12, /* bitsize */
768 FALSE, /* pc_relative */
769 0, /* bitpos */
770 complain_overflow_dont, /* complain_on_overflow */
771 bfd_elf_generic_reloc, /* special_function */
a6bb11b2 772 AARCH64_R_STR (LDST64_ABS_LO12_NC), /* name */
a06ea964
NC		 773 FALSE, /* partial_inplace */
774 0xff8, /* src_mask */
775 0xff8, /* dst_mask */
776 FALSE), /* pcrel_offset */
777
a06ea964 778 /* LD/ST128: (S+A) & 0xff0 */
a6bb11b2 779 HOWTO (AARCH64_R (LDST128_ABS_LO12_NC), /* type */
a06ea964
NC		 780 4, /* rightshift */
781 2, /* size (0 = byte, 1 = short, 2 = long) */
782 12, /* bitsize */
783 FALSE, /* pc_relative */
784 0, /* bitpos */
785 complain_overflow_dont, /* complain_on_overflow */
786 bfd_elf_generic_reloc, /* special_function */
a6bb11b2 787 AARCH64_R_STR (LDST128_ABS_LO12_NC), /* name */
a06ea964
NC		 788 FALSE, /* partial_inplace */
789 0xff0, /* src_mask */
790 0xff0, /* dst_mask */
791 FALSE), /* pcrel_offset */
792
f41aef5f
RE		 793 /* Set a load-literal immediate field to bits
794 0x1FFFFC of G(S)-P */
a6bb11b2 795 HOWTO (AARCH64_R (GOT_LD_PREL19), /* type */
f41aef5f
RE		 796 2, /* rightshift */
797 2, /* size (0 = byte,1 = short,2 = long) */
798 19, /* bitsize */
799 TRUE, /* pc_relative */
800 0, /* bitpos */
801 complain_overflow_signed, /* complain_on_overflow */
802 bfd_elf_generic_reloc, /* special_function */
a6bb11b2 803 AARCH64_R_STR (GOT_LD_PREL19), /* name */
f41aef5f
RE		 804 FALSE, /* partial_inplace */
805 0xffffe0, /* src_mask */
806 0xffffe0, /* dst_mask */
807 TRUE), /* pcrel_offset */
808
a06ea964
NC		 809 /* Get to the page for the GOT entry for the symbol
810 (G(S) - P) using an ADRP instruction. */
a6bb11b2 811 HOWTO (AARCH64_R (ADR_GOT_PAGE), /* type */
a06ea964
NC		 812 12, /* rightshift */
813 2, /* size (0 = byte, 1 = short, 2 = long) */
814 21, /* bitsize */
815 TRUE, /* pc_relative */
816 0, /* bitpos */
817 complain_overflow_dont, /* complain_on_overflow */
818 bfd_elf_generic_reloc, /* special_function */
a6bb11b2 819 AARCH64_R_STR (ADR_GOT_PAGE), /* name */
a06ea964
NC		 820 FALSE, /* partial_inplace */
821 0x1fffff, /* src_mask */
822 0x1fffff, /* dst_mask */
823 TRUE), /* pcrel_offset */
824
a6bb11b2
YZ		 825 /* LD64: GOT offset G(S) & 0xff8 */
826 HOWTO64 (AARCH64_R (LD64_GOT_LO12_NC), /* type */
a06ea964
NC		 827 3, /* rightshift */
828 2, /* size (0 = byte, 1 = short, 2 = long) */
829 12, /* bitsize */
830 FALSE, /* pc_relative */
831 0, /* bitpos */
832 complain_overflow_dont, /* complain_on_overflow */
833 bfd_elf_generic_reloc, /* special_function */
a6bb11b2 834 AARCH64_R_STR (LD64_GOT_LO12_NC), /* name */
a06ea964
NC		 835 FALSE, /* partial_inplace */
836 0xff8, /* src_mask */
837 0xff8, /* dst_mask */
a6bb11b2 838 FALSE), /* pcrel_offset */
a06ea964 839
a6bb11b2
YZ		 840 /* LD32: GOT offset G(S) & 0xffc */
841 HOWTO32 (AARCH64_R (LD32_GOT_LO12_NC), /* type */
842 2, /* rightshift */
843 2, /* size (0 = byte, 1 = short, 2 = long) */
844 12, /* bitsize */
845 FALSE, /* pc_relative */
846 0, /* bitpos */
847 complain_overflow_dont, /* complain_on_overflow */
848 bfd_elf_generic_reloc, /* special_function */
849 AARCH64_R_STR (LD32_GOT_LO12_NC), /* name */
850 FALSE, /* partial_inplace */
851 0xffc, /* src_mask */
852 0xffc, /* dst_mask */
853 FALSE), /* pcrel_offset */
a06ea964 854
87f5fbcc
RL		 855 /* LD64: GOT offset for the symbol. */
856 HOWTO64 (AARCH64_R (LD64_GOTOFF_LO15), /* type */
857 3, /* rightshift */
858 2, /* size (0 = byte, 1 = short, 2 = long) */
859 12, /* bitsize */
860 FALSE, /* pc_relative */
861 0, /* bitpos */
862 complain_overflow_unsigned, /* complain_on_overflow */
863 bfd_elf_generic_reloc, /* special_function */
864 AARCH64_R_STR (LD64_GOTOFF_LO15), /* name */
865 FALSE, /* partial_inplace */
866 0x7ff8, /* src_mask */
867 0x7ff8, /* dst_mask */
868 FALSE), /* pcrel_offset */
869
3d715ce4
JW		 870 /* LD32: GOT offset to the page address of GOT table.
871 (G(S) - PAGE (_GLOBAL_OFFSET_TABLE_)) & 0x5ffc. */
872 HOWTO32 (AARCH64_R (LD32_GOTPAGE_LO14), /* type */
873 2, /* rightshift */
874 2, /* size (0 = byte, 1 = short, 2 = long) */
875 12, /* bitsize */
876 FALSE, /* pc_relative */
877 0, /* bitpos */
878 complain_overflow_unsigned, /* complain_on_overflow */
879 bfd_elf_generic_reloc, /* special_function */
880 AARCH64_R_STR (LD32_GOTPAGE_LO14), /* name */
881 FALSE, /* partial_inplace */
882 0x5ffc, /* src_mask */
883 0x5ffc, /* dst_mask */
884 FALSE), /* pcrel_offset */
885
a921b5bd
JW		 886 /* LD64: GOT offset to the page address of GOT table.
887 (G(S) - PAGE (_GLOBAL_OFFSET_TABLE_)) & 0x7ff8. */
888 HOWTO64 (AARCH64_R (LD64_GOTPAGE_LO15), /* type */
889 3, /* rightshift */
890 2, /* size (0 = byte, 1 = short, 2 = long) */
891 12, /* bitsize */
892 FALSE, /* pc_relative */
893 0, /* bitpos */
894 complain_overflow_unsigned, /* complain_on_overflow */
895 bfd_elf_generic_reloc, /* special_function */
896 AARCH64_R_STR (LD64_GOTPAGE_LO15), /* name */
897 FALSE, /* partial_inplace */
898 0x7ff8, /* src_mask */
899 0x7ff8, /* dst_mask */
900 FALSE), /* pcrel_offset */
901
a06ea964
NC		 902 /* Get to the page for the GOT entry for the symbol
903 (G(S) - P) using an ADRP instruction. */
a6bb11b2 904 HOWTO (AARCH64_R (TLSGD_ADR_PAGE21), /* type */
a06ea964
NC		 905 12, /* rightshift */
906 2, /* size (0 = byte, 1 = short, 2 = long) */
907 21, /* bitsize */
908 TRUE, /* pc_relative */
909 0, /* bitpos */
910 complain_overflow_dont, /* complain_on_overflow */
911 bfd_elf_generic_reloc, /* special_function */
a6bb11b2 912 AARCH64_R_STR (TLSGD_ADR_PAGE21), /* name */
a06ea964
NC		 913 FALSE, /* partial_inplace */
914 0x1fffff, /* src_mask */
915 0x1fffff, /* dst_mask */
916 TRUE), /* pcrel_offset */
917
3c12b054
MS		 918 HOWTO (AARCH64_R (TLSGD_ADR_PREL21), /* type */
919 0, /* rightshift */
920 2, /* size (0 = byte, 1 = short, 2 = long) */
921 21, /* bitsize */
922 TRUE, /* pc_relative */
923 0, /* bitpos */
924 complain_overflow_dont, /* complain_on_overflow */
925 bfd_elf_generic_reloc, /* special_function */
926 AARCH64_R_STR (TLSGD_ADR_PREL21), /* name */
927 FALSE, /* partial_inplace */
928 0x1fffff, /* src_mask */
929 0x1fffff, /* dst_mask */
930 TRUE), /* pcrel_offset */
931
a06ea964 932 /* ADD: GOT offset G(S) & 0xff8 [no overflow check] */
a6bb11b2 933 HOWTO (AARCH64_R (TLSGD_ADD_LO12_NC), /* type */
a06ea964
NC		 934 0, /* rightshift */
935 2, /* size (0 = byte, 1 = short, 2 = long) */
936 12, /* bitsize */
937 FALSE, /* pc_relative */
938 0, /* bitpos */
939 complain_overflow_dont, /* complain_on_overflow */
940 bfd_elf_generic_reloc, /* special_function */
a6bb11b2 941 AARCH64_R_STR (TLSGD_ADD_LO12_NC), /* name */
a06ea964
NC		 942 FALSE, /* partial_inplace */
943 0xfff, /* src_mask */
944 0xfff, /* dst_mask */
945 FALSE), /* pcrel_offset */
946
a6bb11b2 947 HOWTO64 (AARCH64_R (TLSIE_MOVW_GOTTPREL_G1), /* type */
a06ea964
NC		 948 16, /* rightshift */
949 2, /* size (0 = byte, 1 = short, 2 = long) */
950 16, /* bitsize */
951 FALSE, /* pc_relative */
952 0, /* bitpos */
953 complain_overflow_dont, /* complain_on_overflow */
954 bfd_elf_generic_reloc, /* special_function */
a6bb11b2 955 AARCH64_R_STR (TLSIE_MOVW_GOTTPREL_G1), /* name */
a06ea964
NC		 956 FALSE, /* partial_inplace */
957 0xffff, /* src_mask */
958 0xffff, /* dst_mask */
959 FALSE), /* pcrel_offset */
960
a6bb11b2 961 HOWTO64 (AARCH64_R (TLSIE_MOVW_GOTTPREL_G0_NC), /* type */
a06ea964
NC		 962 0, /* rightshift */
963 2, /* size (0 = byte, 1 = short, 2 = long) */
49d8f92c 964 16, /* bitsize */
a06ea964
NC		 965 FALSE, /* pc_relative */
966 0, /* bitpos */
967 complain_overflow_dont, /* complain_on_overflow */
968 bfd_elf_generic_reloc, /* special_function */
a6bb11b2 969 AARCH64_R_STR (TLSIE_MOVW_GOTTPREL_G0_NC), /* name */
a06ea964
NC		 970 FALSE, /* partial_inplace */
971 0xffff, /* src_mask */
972 0xffff, /* dst_mask */
973 FALSE), /* pcrel_offset */
974
a6bb11b2 975 HOWTO (AARCH64_R (TLSIE_ADR_GOTTPREL_PAGE21), /* type */
a06ea964
NC		 976 12, /* rightshift */
977 2, /* size (0 = byte, 1 = short, 2 = long) */
978 21, /* bitsize */
979 FALSE, /* pc_relative */
980 0, /* bitpos */
981 complain_overflow_dont, /* complain_on_overflow */
982 bfd_elf_generic_reloc, /* special_function */
a6bb11b2 983 AARCH64_R_STR (TLSIE_ADR_GOTTPREL_PAGE21), /* name */
a06ea964
NC		 984 FALSE, /* partial_inplace */
985 0x1fffff, /* src_mask */
986 0x1fffff, /* dst_mask */
987 FALSE), /* pcrel_offset */
988
a6bb11b2 989 HOWTO64 (AARCH64_R (TLSIE_LD64_GOTTPREL_LO12_NC), /* type */
a06ea964
NC		 990 3, /* rightshift */
991 2, /* size (0 = byte, 1 = short, 2 = long) */
992 12, /* bitsize */
993 FALSE, /* pc_relative */
994 0, /* bitpos */
995 complain_overflow_dont, /* complain_on_overflow */
996 bfd_elf_generic_reloc, /* special_function */
a6bb11b2 997 AARCH64_R_STR (TLSIE_LD64_GOTTPREL_LO12_NC), /* name */
a06ea964
NC		 998 FALSE, /* partial_inplace */
999 0xff8, /* src_mask */
1000 0xff8, /* dst_mask */
1001 FALSE), /* pcrel_offset */
1002
a6bb11b2
YZ		 1003 HOWTO32 (AARCH64_R (TLSIE_LD32_GOTTPREL_LO12_NC), /* type */
1004 2, /* rightshift */
1005 2, /* size (0 = byte, 1 = short, 2 = long) */
1006 12, /* bitsize */
1007 FALSE, /* pc_relative */
1008 0, /* bitpos */
1009 complain_overflow_dont, /* complain_on_overflow */
1010 bfd_elf_generic_reloc, /* special_function */
1011 AARCH64_R_STR (TLSIE_LD32_GOTTPREL_LO12_NC), /* name */
1012 FALSE, /* partial_inplace */
1013 0xffc, /* src_mask */
1014 0xffc, /* dst_mask */
1015 FALSE), /* pcrel_offset */
1016
1017 HOWTO (AARCH64_R (TLSIE_LD_GOTTPREL_PREL19), /* type */
bb3f9ed8 1018 2, /* rightshift */
a06ea964 1019 2, /* size (0 = byte, 1 = short, 2 = long) */
043bf05a 1020 19, /* bitsize */
a06ea964
NC		 1021 FALSE, /* pc_relative */
1022 0, /* bitpos */
1023 complain_overflow_dont, /* complain_on_overflow */
1024 bfd_elf_generic_reloc, /* special_function */
a6bb11b2 1025 AARCH64_R_STR (TLSIE_LD_GOTTPREL_PREL19), /* name */
a06ea964
NC		 1026 FALSE, /* partial_inplace */
1027 0x1ffffc, /* src_mask */
1028 0x1ffffc, /* dst_mask */
1029 FALSE), /* pcrel_offset */
1030
70151fb5
JW		 1031 /* Unsigned 12 bit byte offset to module TLS base address. */
1032 HOWTO (AARCH64_R (TLSLD_ADD_DTPREL_LO12), /* type */
1033 0, /* rightshift */
1034 2, /* size (0 = byte, 1 = short, 2 = long) */
1035 12, /* bitsize */
1036 FALSE, /* pc_relative */
1037 0, /* bitpos */
1038 complain_overflow_unsigned, /* complain_on_overflow */
1039 bfd_elf_generic_reloc, /* special_function */
1040 AARCH64_R_STR (TLSLD_ADD_DTPREL_LO12), /* name */
1041 FALSE, /* partial_inplace */
1042 0xfff, /* src_mask */
1043 0xfff, /* dst_mask */
1044 FALSE), /* pcrel_offset */
1045
a12fad50
JW		 1046 /* ADD: GOT offset G(S) & 0xff8 [no overflow check] */
1047 HOWTO (AARCH64_R (TLSLD_ADD_LO12_NC), /* type */
1048 0, /* rightshift */
1049 2, /* size (0 = byte, 1 = short, 2 = long) */
1050 12, /* bitsize */
1051 FALSE, /* pc_relative */
1052 0, /* bitpos */
1053 complain_overflow_dont, /* complain_on_overflow */
1054 bfd_elf_generic_reloc, /* special_function */
1055 AARCH64_R_STR (TLSLD_ADD_LO12_NC), /* name */
1056 FALSE, /* partial_inplace */
1057 0xfff, /* src_mask */
1058 0xfff, /* dst_mask */
1059 FALSE), /* pcrel_offset */
1060
1107e076
JW		 1061 /* Get to the page for the GOT entry for the symbol
1062 (G(S) - P) using an ADRP instruction. */
1063 HOWTO (AARCH64_R (TLSLD_ADR_PAGE21), /* type */
1064 12, /* rightshift */
1065 2, /* size (0 = byte, 1 = short, 2 = long) */
1066 21, /* bitsize */
1067 TRUE, /* pc_relative */
1068 0, /* bitpos */
1069 complain_overflow_signed, /* complain_on_overflow */
1070 bfd_elf_generic_reloc, /* special_function */
1071 AARCH64_R_STR (TLSLD_ADR_PAGE21), /* name */
1072 FALSE, /* partial_inplace */
1073 0x1fffff, /* src_mask */
1074 0x1fffff, /* dst_mask */
1075 TRUE), /* pcrel_offset */
1076
6c37fedc
JW		 1077 HOWTO (AARCH64_R (TLSLD_ADR_PREL21), /* type */
1078 0, /* rightshift */
1079 2, /* size (0 = byte, 1 = short, 2 = long) */
1080 21, /* bitsize */
1081 TRUE, /* pc_relative */
1082 0, /* bitpos */
1083 complain_overflow_signed, /* complain_on_overflow */
1084 bfd_elf_generic_reloc, /* special_function */
1085 AARCH64_R_STR (TLSLD_ADR_PREL21), /* name */
1086 FALSE, /* partial_inplace */
1087 0x1fffff, /* src_mask */
1088 0x1fffff, /* dst_mask */
1089 TRUE), /* pcrel_offset */
1090
a6bb11b2 1091 HOWTO64 (AARCH64_R (TLSLE_MOVW_TPREL_G2), /* type */
bb3f9ed8 1092 32, /* rightshift */
a06ea964 1093 2, /* size (0 = byte, 1 = short, 2 = long) */
07875fbc 1094 16, /* bitsize */
a06ea964
NC		 1095 FALSE, /* pc_relative */
1096 0, /* bitpos */
0172429c 1097 complain_overflow_unsigned, /* complain_on_overflow */
a06ea964 1098 bfd_elf_generic_reloc, /* special_function */
a6bb11b2 1099 AARCH64_R_STR (TLSLE_MOVW_TPREL_G2), /* name */
a06ea964
NC		 1100 FALSE, /* partial_inplace */
1101 0xffff, /* src_mask */
1102 0xffff, /* dst_mask */
1103 FALSE), /* pcrel_offset */
1104
a6bb11b2 1105 HOWTO (AARCH64_R (TLSLE_MOVW_TPREL_G1), /* type */
bb3f9ed8 1106 16, /* rightshift */
a06ea964 1107 2, /* size (0 = byte, 1 = short, 2 = long) */
07875fbc 1108 16, /* bitsize */
a06ea964
NC		 1109 FALSE, /* pc_relative */
1110 0, /* bitpos */
1111 complain_overflow_dont, /* complain_on_overflow */
1112 bfd_elf_generic_reloc, /* special_function */
a6bb11b2 1113 AARCH64_R_STR (TLSLE_MOVW_TPREL_G1), /* name */
a06ea964
NC		 1114 FALSE, /* partial_inplace */
1115 0xffff, /* src_mask */
1116 0xffff, /* dst_mask */
1117 FALSE), /* pcrel_offset */
1118
a6bb11b2 1119 HOWTO64 (AARCH64_R (TLSLE_MOVW_TPREL_G1_NC), /* type */
bb3f9ed8 1120 16, /* rightshift */
a06ea964 1121 2, /* size (0 = byte, 1 = short, 2 = long) */
07875fbc 1122 16, /* bitsize */
a06ea964
NC		 1123 FALSE, /* pc_relative */
1124 0, /* bitpos */
1125 complain_overflow_dont, /* complain_on_overflow */
1126 bfd_elf_generic_reloc, /* special_function */
a6bb11b2 1127 AARCH64_R_STR (TLSLE_MOVW_TPREL_G1_NC), /* name */
a06ea964
NC		 1128 FALSE, /* partial_inplace */
1129 0xffff, /* src_mask */
1130 0xffff, /* dst_mask */
1131 FALSE), /* pcrel_offset */
1132
a6bb11b2 1133 HOWTO (AARCH64_R (TLSLE_MOVW_TPREL_G0), /* type */
a06ea964
NC		 1134 0, /* rightshift */
1135 2, /* size (0 = byte, 1 = short, 2 = long) */
07875fbc 1136 16, /* bitsize */
a06ea964
NC		 1137 FALSE, /* pc_relative */
1138 0, /* bitpos */
1139 complain_overflow_dont, /* complain_on_overflow */
1140 bfd_elf_generic_reloc, /* special_function */
a6bb11b2 1141 AARCH64_R_STR (TLSLE_MOVW_TPREL_G0), /* name */
a06ea964
NC		 1142 FALSE, /* partial_inplace */
1143 0xffff, /* src_mask */
1144 0xffff, /* dst_mask */
1145 FALSE), /* pcrel_offset */
1146
a6bb11b2 1147 HOWTO (AARCH64_R (TLSLE_MOVW_TPREL_G0_NC), /* type */
a06ea964
NC		 1148 0, /* rightshift */
1149 2, /* size (0 = byte, 1 = short, 2 = long) */
07875fbc 1150 16, /* bitsize */
a06ea964
NC		 1151 FALSE, /* pc_relative */
1152 0, /* bitpos */
1153 complain_overflow_dont, /* complain_on_overflow */
1154 bfd_elf_generic_reloc, /* special_function */
a6bb11b2 1155 AARCH64_R_STR (TLSLE_MOVW_TPREL_G0_NC), /* name */
a06ea964
NC		 1156 FALSE, /* partial_inplace */
1157 0xffff, /* src_mask */
1158 0xffff, /* dst_mask */
1159 FALSE), /* pcrel_offset */
1160
a6bb11b2 1161 HOWTO (AARCH64_R (TLSLE_ADD_TPREL_HI12), /* type */
bb3f9ed8 1162 12, /* rightshift */
a06ea964
NC		 1163 2, /* size (0 = byte, 1 = short, 2 = long) */
1164 12, /* bitsize */
1165 FALSE, /* pc_relative */
1166 0, /* bitpos */
bab91cce 1167 complain_overflow_unsigned, /* complain_on_overflow */
a06ea964 1168 bfd_elf_generic_reloc, /* special_function */
a6bb11b2 1169 AARCH64_R_STR (TLSLE_ADD_TPREL_HI12), /* name */
a06ea964
NC		 1170 FALSE, /* partial_inplace */
1171 0xfff, /* src_mask */
1172 0xfff, /* dst_mask */
1173 FALSE), /* pcrel_offset */
1174
a6bb11b2 1175 HOWTO (AARCH64_R (TLSLE_ADD_TPREL_LO12), /* type */
a06ea964
NC		 1176 0, /* rightshift */
1177 2, /* size (0 = byte, 1 = short, 2 = long) */
1178 12, /* bitsize */
1179 FALSE, /* pc_relative */
1180 0, /* bitpos */
36e6c140 1181 complain_overflow_unsigned, /* complain_on_overflow */
a06ea964 1182 bfd_elf_generic_reloc, /* special_function */
a6bb11b2 1183 AARCH64_R_STR (TLSLE_ADD_TPREL_LO12), /* name */
a06ea964
NC		 1184 FALSE, /* partial_inplace */
1185 0xfff, /* src_mask */
1186 0xfff, /* dst_mask */
1187 FALSE), /* pcrel_offset */
1188
a6bb11b2 1189 HOWTO (AARCH64_R (TLSLE_ADD_TPREL_LO12_NC), /* type */
a06ea964
NC		 1190 0, /* rightshift */
1191 2, /* size (0 = byte, 1 = short, 2 = long) */
1192 12, /* bitsize */
1193 FALSE, /* pc_relative */
1194 0, /* bitpos */
1195 complain_overflow_dont, /* complain_on_overflow */
1196 bfd_elf_generic_reloc, /* special_function */
a6bb11b2 1197 AARCH64_R_STR (TLSLE_ADD_TPREL_LO12_NC), /* name */
a06ea964
NC		 1198 FALSE, /* partial_inplace */
1199 0xfff, /* src_mask */
1200 0xfff, /* dst_mask */
1201 FALSE), /* pcrel_offset */
a06ea964 1202
a6bb11b2 1203 HOWTO (AARCH64_R (TLSDESC_LD_PREL19), /* type */
bb3f9ed8 1204 2, /* rightshift */
a06ea964 1205 2, /* size (0 = byte, 1 = short, 2 = long) */
1ada945d 1206 19, /* bitsize */
a06ea964
NC		 1207 TRUE, /* pc_relative */
1208 0, /* bitpos */
1209 complain_overflow_dont, /* complain_on_overflow */
1210 bfd_elf_generic_reloc, /* special_function */
a6bb11b2 1211 AARCH64_R_STR (TLSDESC_LD_PREL19), /* name */
a06ea964 1212 FALSE, /* partial_inplace */
1ada945d
MS		 1213 0x0ffffe0, /* src_mask */
1214 0x0ffffe0, /* dst_mask */
a06ea964
NC		 1215 TRUE), /* pcrel_offset */
1216
a6bb11b2 1217 HOWTO (AARCH64_R (TLSDESC_ADR_PREL21), /* type */
a06ea964
NC		 1218 0, /* rightshift */
1219 2, /* size (0 = byte, 1 = short, 2 = long) */
1220 21, /* bitsize */
1221 TRUE, /* pc_relative */
1222 0, /* bitpos */
1223 complain_overflow_dont, /* complain_on_overflow */
1224 bfd_elf_generic_reloc, /* special_function */
a6bb11b2 1225 AARCH64_R_STR (TLSDESC_ADR_PREL21), /* name */
a06ea964
NC		 1226 FALSE, /* partial_inplace */
1227 0x1fffff, /* src_mask */
1228 0x1fffff, /* dst_mask */
1229 TRUE), /* pcrel_offset */
1230
1231 /* Get to the page for the GOT entry for the symbol
1232 (G(S) - P) using an ADRP instruction. */
a6bb11b2 1233 HOWTO (AARCH64_R (TLSDESC_ADR_PAGE21), /* type */
a06ea964
NC		 1234 12, /* rightshift */
1235 2, /* size (0 = byte, 1 = short, 2 = long) */
1236 21, /* bitsize */
1237 TRUE, /* pc_relative */
1238 0, /* bitpos */
1239 complain_overflow_dont, /* complain_on_overflow */
1240 bfd_elf_generic_reloc, /* special_function */
a6bb11b2 1241 AARCH64_R_STR (TLSDESC_ADR_PAGE21), /* name */
a06ea964
NC		 1242 FALSE, /* partial_inplace */
1243 0x1fffff, /* src_mask */
1244 0x1fffff, /* dst_mask */
1245 TRUE), /* pcrel_offset */
1246
a6bb11b2
YZ		 1247 /* LD64: GOT offset G(S) & 0xff8. */
1248 HOWTO64 (AARCH64_R (TLSDESC_LD64_LO12_NC), /* type */
a06ea964
NC		 1249 3, /* rightshift */
1250 2, /* size (0 = byte, 1 = short, 2 = long) */
1251 12, /* bitsize */
1252 FALSE, /* pc_relative */
1253 0, /* bitpos */
1254 complain_overflow_dont, /* complain_on_overflow */
1255 bfd_elf_generic_reloc, /* special_function */
a6bb11b2 1256 AARCH64_R_STR (TLSDESC_LD64_LO12_NC), /* name */
a06ea964 1257 FALSE, /* partial_inplace */
a6bb11b2
YZ		 1258 0xff8, /* src_mask */
1259 0xff8, /* dst_mask */
1260 FALSE), /* pcrel_offset */
1261
1262 /* LD32: GOT offset G(S) & 0xffc. */
1263 HOWTO32 (AARCH64_R (TLSDESC_LD32_LO12_NC), /* type */
1264 2, /* rightshift */
1265 2, /* size (0 = byte, 1 = short, 2 = long) */
1266 12, /* bitsize */
1267 FALSE, /* pc_relative */
1268 0, /* bitpos */
1269 complain_overflow_dont, /* complain_on_overflow */
1270 bfd_elf_generic_reloc, /* special_function */
1271 AARCH64_R_STR (TLSDESC_LD32_LO12_NC), /* name */
1272 FALSE, /* partial_inplace */
1273 0xffc, /* src_mask */
1274 0xffc, /* dst_mask */
a06ea964
NC		 1275 FALSE), /* pcrel_offset */
1276
1277 /* ADD: GOT offset G(S) & 0xfff. */
a6bb11b2 1278 HOWTO (AARCH64_R (TLSDESC_ADD_LO12_NC), /* type */
a06ea964
NC		 1279 0, /* rightshift */
1280 2, /* size (0 = byte, 1 = short, 2 = long) */
1281 12, /* bitsize */
1282 FALSE, /* pc_relative */
1283 0, /* bitpos */
1284 complain_overflow_dont, /* complain_on_overflow */
1285 bfd_elf_generic_reloc, /* special_function */
a6bb11b2 1286 AARCH64_R_STR (TLSDESC_ADD_LO12_NC), /* name */
a06ea964
NC		 1287 FALSE, /* partial_inplace */
1288 0xfff, /* src_mask */
1289 0xfff, /* dst_mask */
1290 FALSE), /* pcrel_offset */
1291
a6bb11b2 1292 HOWTO64 (AARCH64_R (TLSDESC_OFF_G1), /* type */
bb3f9ed8 1293 16, /* rightshift */
a06ea964
NC		 1294 2, /* size (0 = byte, 1 = short, 2 = long) */
1295 12, /* bitsize */
1296 FALSE, /* pc_relative */
1297 0, /* bitpos */
1298 complain_overflow_dont, /* complain_on_overflow */
1299 bfd_elf_generic_reloc, /* special_function */
a6bb11b2 1300 AARCH64_R_STR (TLSDESC_OFF_G1), /* name */
a06ea964
NC		 1301 FALSE, /* partial_inplace */
1302 0xffff, /* src_mask */
1303 0xffff, /* dst_mask */
1304 FALSE), /* pcrel_offset */
1305
a6bb11b2 1306 HOWTO64 (AARCH64_R (TLSDESC_OFF_G0_NC), /* type */
a06ea964
NC		 1307 0, /* rightshift */
1308 2, /* size (0 = byte, 1 = short, 2 = long) */
1309 12, /* bitsize */
1310 FALSE, /* pc_relative */
1311 0, /* bitpos */
1312 complain_overflow_dont, /* complain_on_overflow */
1313 bfd_elf_generic_reloc, /* special_function */
a6bb11b2 1314 AARCH64_R_STR (TLSDESC_OFF_G0_NC), /* name */
a06ea964
NC		 1315 FALSE, /* partial_inplace */
1316 0xffff, /* src_mask */
1317 0xffff, /* dst_mask */
1318 FALSE), /* pcrel_offset */
1319
a6bb11b2 1320 HOWTO64 (AARCH64_R (TLSDESC_LDR), /* type */
a06ea964
NC		 1321 0, /* rightshift */
1322 2, /* size (0 = byte, 1 = short, 2 = long) */
1323 12, /* bitsize */
1324 FALSE, /* pc_relative */
1325 0, /* bitpos */
1326 complain_overflow_dont, /* complain_on_overflow */
1327 bfd_elf_generic_reloc, /* special_function */
a6bb11b2 1328 AARCH64_R_STR (TLSDESC_LDR), /* name */
a06ea964
NC		 1329 FALSE, /* partial_inplace */
1330 0x0, /* src_mask */
1331 0x0, /* dst_mask */
1332 FALSE), /* pcrel_offset */
1333
a6bb11b2 1334 HOWTO64 (AARCH64_R (TLSDESC_ADD), /* type */
a06ea964
NC		 1335 0, /* rightshift */
1336 2, /* size (0 = byte, 1 = short, 2 = long) */
1337 12, /* bitsize */
1338 FALSE, /* pc_relative */
1339 0, /* bitpos */
1340 complain_overflow_dont, /* complain_on_overflow */
1341 bfd_elf_generic_reloc, /* special_function */
a6bb11b2 1342 AARCH64_R_STR (TLSDESC_ADD), /* name */
a06ea964
NC		 1343 FALSE, /* partial_inplace */
1344 0x0, /* src_mask */
1345 0x0, /* dst_mask */
1346 FALSE), /* pcrel_offset */
1347
a6bb11b2 1348 HOWTO (AARCH64_R (TLSDESC_CALL), /* type */
a06ea964
NC		 1349 0, /* rightshift */
1350 2, /* size (0 = byte, 1 = short, 2 = long) */
7366006f 1351 0, /* bitsize */
a06ea964
NC		 1352 FALSE, /* pc_relative */
1353 0, /* bitpos */
1354 complain_overflow_dont, /* complain_on_overflow */
1355 bfd_elf_generic_reloc, /* special_function */
a6bb11b2 1356 AARCH64_R_STR (TLSDESC_CALL), /* name */
a06ea964
NC		 1357 FALSE, /* partial_inplace */
1358 0x0, /* src_mask */
1359 0x0, /* dst_mask */
1360 FALSE), /* pcrel_offset */
a6bb11b2
YZ		 1361
1362 HOWTO (AARCH64_R (COPY), /* type */
1363 0, /* rightshift */
1364 2, /* size (0 = byte, 1 = short, 2 = long) */
1365 64, /* bitsize */
1366 FALSE, /* pc_relative */
1367 0, /* bitpos */
1368 complain_overflow_bitfield, /* complain_on_overflow */
1369 bfd_elf_generic_reloc, /* special_function */
1370 AARCH64_R_STR (COPY), /* name */
1371 TRUE, /* partial_inplace */
1372 0xffffffff, /* src_mask */
1373 0xffffffff, /* dst_mask */
1374 FALSE), /* pcrel_offset */
1375
1376 HOWTO (AARCH64_R (GLOB_DAT), /* type */
1377 0, /* rightshift */
1378 2, /* size (0 = byte, 1 = short, 2 = long) */
1379 64, /* bitsize */
1380 FALSE, /* pc_relative */
1381 0, /* bitpos */
1382 complain_overflow_bitfield, /* complain_on_overflow */
1383 bfd_elf_generic_reloc, /* special_function */
1384 AARCH64_R_STR (GLOB_DAT), /* name */
1385 TRUE, /* partial_inplace */
1386 0xffffffff, /* src_mask */
1387 0xffffffff, /* dst_mask */
1388 FALSE), /* pcrel_offset */
1389
1390 HOWTO (AARCH64_R (JUMP_SLOT), /* type */
1391 0, /* rightshift */
1392 2, /* size (0 = byte, 1 = short, 2 = long) */
1393 64, /* bitsize */
1394 FALSE, /* pc_relative */
1395 0, /* bitpos */
1396 complain_overflow_bitfield, /* complain_on_overflow */
1397 bfd_elf_generic_reloc, /* special_function */
1398 AARCH64_R_STR (JUMP_SLOT), /* name */
1399 TRUE, /* partial_inplace */
1400 0xffffffff, /* src_mask */
1401 0xffffffff, /* dst_mask */
1402 FALSE), /* pcrel_offset */
1403
1404 HOWTO (AARCH64_R (RELATIVE), /* type */
1405 0, /* rightshift */
1406 2, /* size (0 = byte, 1 = short, 2 = long) */
1407 64, /* bitsize */
1408 FALSE, /* pc_relative */
1409 0, /* bitpos */
1410 complain_overflow_bitfield, /* complain_on_overflow */
1411 bfd_elf_generic_reloc, /* special_function */
1412 AARCH64_R_STR (RELATIVE), /* name */
1413 TRUE, /* partial_inplace */
1414 ALL_ONES, /* src_mask */
1415 ALL_ONES, /* dst_mask */
1416 FALSE), /* pcrel_offset */
1417
1418 HOWTO (AARCH64_R (TLS_DTPMOD), /* type */
1419 0, /* rightshift */
1420 2, /* size (0 = byte, 1 = short, 2 = long) */
1421 64, /* bitsize */
1422 FALSE, /* pc_relative */
1423 0, /* bitpos */
1424 complain_overflow_dont, /* complain_on_overflow */
1425 bfd_elf_generic_reloc, /* special_function */
da0781dc
YZ		 1426#if ARCH_SIZE == 64
1427 AARCH64_R_STR (TLS_DTPMOD64), /* name */
1428#else
a6bb11b2 1429 AARCH64_R_STR (TLS_DTPMOD), /* name */
da0781dc 1430#endif
a6bb11b2
YZ		 1431 FALSE, /* partial_inplace */
1432 0, /* src_mask */
1433 ALL_ONES, /* dst_mask */
1434 FALSE), /* pc_reloffset */
1435
1436 HOWTO (AARCH64_R (TLS_DTPREL), /* type */
1437 0, /* rightshift */
1438 2, /* size (0 = byte, 1 = short, 2 = long) */
1439 64, /* bitsize */
1440 FALSE, /* pc_relative */
1441 0, /* bitpos */
1442 complain_overflow_dont, /* complain_on_overflow */
1443 bfd_elf_generic_reloc, /* special_function */
da0781dc
YZ		 1444#if ARCH_SIZE == 64
1445 AARCH64_R_STR (TLS_DTPREL64), /* name */
1446#else
a6bb11b2 1447 AARCH64_R_STR (TLS_DTPREL), /* name */
da0781dc 1448#endif
a6bb11b2
YZ		 1449 FALSE, /* partial_inplace */
1450 0, /* src_mask */
1451 ALL_ONES, /* dst_mask */
1452 FALSE), /* pcrel_offset */
1453
1454 HOWTO (AARCH64_R (TLS_TPREL), /* type */
1455 0, /* rightshift */
1456 2, /* size (0 = byte, 1 = short, 2 = long) */
1457 64, /* bitsize */
1458 FALSE, /* pc_relative */
1459 0, /* bitpos */
1460 complain_overflow_dont, /* complain_on_overflow */
1461 bfd_elf_generic_reloc, /* special_function */
da0781dc
YZ		 1462#if ARCH_SIZE == 64
1463 AARCH64_R_STR (TLS_TPREL64), /* name */
1464#else
a6bb11b2 1465 AARCH64_R_STR (TLS_TPREL), /* name */
da0781dc 1466#endif
a6bb11b2
YZ		 1467 FALSE, /* partial_inplace */
1468 0, /* src_mask */
1469 ALL_ONES, /* dst_mask */
1470 FALSE), /* pcrel_offset */
1471
1472 HOWTO (AARCH64_R (TLSDESC), /* type */
1473 0, /* rightshift */
1474 2, /* size (0 = byte, 1 = short, 2 = long) */
1475 64, /* bitsize */
1476 FALSE, /* pc_relative */
1477 0, /* bitpos */
1478 complain_overflow_dont, /* complain_on_overflow */
1479 bfd_elf_generic_reloc, /* special_function */
1480 AARCH64_R_STR (TLSDESC), /* name */
1481 FALSE, /* partial_inplace */
1482 0, /* src_mask */
1483 ALL_ONES, /* dst_mask */
1484 FALSE), /* pcrel_offset */
1485
1486 HOWTO (AARCH64_R (IRELATIVE), /* type */
1487 0, /* rightshift */
1488 2, /* size (0 = byte, 1 = short, 2 = long) */
1489 64, /* bitsize */
1490 FALSE, /* pc_relative */
1491 0, /* bitpos */
1492 complain_overflow_bitfield, /* complain_on_overflow */
1493 bfd_elf_generic_reloc, /* special_function */
1494 AARCH64_R_STR (IRELATIVE), /* name */
1495 FALSE, /* partial_inplace */
1496 0, /* src_mask */
1497 ALL_ONES, /* dst_mask */
1498 FALSE), /* pcrel_offset */
1499
1500 EMPTY_HOWTO (0),
a06ea964
NC		 1501};
1502
a6bb11b2
YZ		 1503static reloc_howto_type elfNN_aarch64_howto_none =
1504 HOWTO (R_AARCH64_NONE, /* type */
1505 0, /* rightshift */
6346d5ca 1506 3, /* size (0 = byte, 1 = short, 2 = long) */
a6bb11b2
YZ		 1507 0, /* bitsize */
1508 FALSE, /* pc_relative */
1509 0, /* bitpos */
1510 complain_overflow_dont,/* complain_on_overflow */
1511 bfd_elf_generic_reloc, /* special_function */
1512 "R_AARCH64_NONE", /* name */
1513 FALSE, /* partial_inplace */
1514 0, /* src_mask */
1515 0, /* dst_mask */
1516 FALSE); /* pcrel_offset */
1517
1518/* Given HOWTO, return the bfd internal relocation enumerator. */
1519
1520static bfd_reloc_code_real_type
1521elfNN_aarch64_bfd_reloc_from_howto (reloc_howto_type *howto)
1522{
1523 const int size
1524 = (int) ARRAY_SIZE (elfNN_aarch64_howto_table);
1525 const ptrdiff_t offset
1526 = howto - elfNN_aarch64_howto_table;
1527
1528 if (offset > 0 && offset < size - 1)
1529 return BFD_RELOC_AARCH64_RELOC_START + offset;
1530
1531 if (howto == &elfNN_aarch64_howto_none)
1532 return BFD_RELOC_AARCH64_NONE;
1533
1534 return BFD_RELOC_AARCH64_RELOC_START;
1535}
1536
1537/* Given R_TYPE, return the bfd internal relocation enumerator. */
1538
1539static bfd_reloc_code_real_type
1540elfNN_aarch64_bfd_reloc_from_type (unsigned int r_type)
1541{
1542 static bfd_boolean initialized_p = FALSE;
1543 /* Indexed by R_TYPE, values are offsets in the howto_table. */
1544 static unsigned int offsets[R_AARCH64_end];
1545
1546 if (initialized_p == FALSE)
1547 {
1548 unsigned int i;
1549
1550 for (i = 1; i < ARRAY_SIZE (elfNN_aarch64_howto_table) - 1; ++i)
1551 if (elfNN_aarch64_howto_table[i].type != 0)
1552 offsets[elfNN_aarch64_howto_table[i].type] = i;
1553
1554 initialized_p = TRUE;
1555 }
1556
1557 if (r_type == R_AARCH64_NONE || r_type == R_AARCH64_NULL)
1558 return BFD_RELOC_AARCH64_NONE;
1559
5860e3f8
NC		 1560 /* PR 17512: file: b371e70a. */
1561 if (r_type >= R_AARCH64_end)
1562 {
1563 _bfd_error_handler (_("Invalid AArch64 reloc number: %d"), r_type);
1564 bfd_set_error (bfd_error_bad_value);
1565 return BFD_RELOC_AARCH64_NONE;
1566 }
1567
a6bb11b2
YZ		 1568 return BFD_RELOC_AARCH64_RELOC_START + offsets[r_type];
1569}
1570
1571struct elf_aarch64_reloc_map
1572{
1573 bfd_reloc_code_real_type from;
1574 bfd_reloc_code_real_type to;
1575};
1576
1577/* Map bfd generic reloc to AArch64-specific reloc. */
1578static const struct elf_aarch64_reloc_map elf_aarch64_reloc_map[] =
1579{
1580 {BFD_RELOC_NONE, BFD_RELOC_AARCH64_NONE},
1581
1582 /* Basic data relocations. */
1583 {BFD_RELOC_CTOR, BFD_RELOC_AARCH64_NN},
1584 {BFD_RELOC_64, BFD_RELOC_AARCH64_64},
1585 {BFD_RELOC_32, BFD_RELOC_AARCH64_32},
1586 {BFD_RELOC_16, BFD_RELOC_AARCH64_16},
1587 {BFD_RELOC_64_PCREL, BFD_RELOC_AARCH64_64_PCREL},
1588 {BFD_RELOC_32_PCREL, BFD_RELOC_AARCH64_32_PCREL},
1589 {BFD_RELOC_16_PCREL, BFD_RELOC_AARCH64_16_PCREL},
1590};
1591
1592/* Given the bfd internal relocation enumerator in CODE, return the
1593 corresponding howto entry. */
1594
1595static reloc_howto_type *
1596elfNN_aarch64_howto_from_bfd_reloc (bfd_reloc_code_real_type code)
1597{
1598 unsigned int i;
1599
1600 /* Convert bfd generic reloc to AArch64-specific reloc. */
1601 if (code < BFD_RELOC_AARCH64_RELOC_START
1602 || code > BFD_RELOC_AARCH64_RELOC_END)
1603 for (i = 0; i < ARRAY_SIZE (elf_aarch64_reloc_map); i++)
1604 if (elf_aarch64_reloc_map[i].from == code)
1605 {
1606 code = elf_aarch64_reloc_map[i].to;
1607 break;
1608 }
1609
1610 if (code > BFD_RELOC_AARCH64_RELOC_START
1611 && code < BFD_RELOC_AARCH64_RELOC_END)
1612 if (elfNN_aarch64_howto_table[code - BFD_RELOC_AARCH64_RELOC_START].type)
1613 return &elfNN_aarch64_howto_table[code - BFD_RELOC_AARCH64_RELOC_START];
1614
54757ed1
AP		 1615 if (code == BFD_RELOC_AARCH64_NONE)
1616 return &elfNN_aarch64_howto_none;
1617
a6bb11b2
YZ		 1618 return NULL;
1619}
1620
a06ea964 1621static reloc_howto_type *
cec5225b 1622elfNN_aarch64_howto_from_type (unsigned int r_type)
a06ea964 1623{
a6bb11b2
YZ		 1624 bfd_reloc_code_real_type val;
1625 reloc_howto_type *howto;
1626
cec5225b
YZ		 1627#if ARCH_SIZE == 32
1628 if (r_type > 256)
1629 {
1630 bfd_set_error (bfd_error_bad_value);
1631 return NULL;
1632 }
1633#endif
1634
a6bb11b2
YZ		 1635 if (r_type == R_AARCH64_NONE)
1636 return &elfNN_aarch64_howto_none;
a06ea964 1637
a6bb11b2
YZ		 1638 val = elfNN_aarch64_bfd_reloc_from_type (r_type);
1639 howto = elfNN_aarch64_howto_from_bfd_reloc (val);
a06ea964 1640
a6bb11b2
YZ		 1641 if (howto != NULL)
1642 return howto;
a06ea964 1643
a06ea964
NC		 1644 bfd_set_error (bfd_error_bad_value);
1645 return NULL;
1646}
1647
1648static void
cec5225b 1649elfNN_aarch64_info_to_howto (bfd *abfd ATTRIBUTE_UNUSED, arelent *bfd_reloc,
a06ea964
NC		 1650 Elf_Internal_Rela *elf_reloc)
1651{
1652 unsigned int r_type;
1653
cec5225b
YZ		 1654 r_type = ELFNN_R_TYPE (elf_reloc->r_info);
1655 bfd_reloc->howto = elfNN_aarch64_howto_from_type (r_type);
a06ea964
NC		 1656}
1657
a06ea964 1658static reloc_howto_type *
cec5225b 1659elfNN_aarch64_reloc_type_lookup (bfd *abfd ATTRIBUTE_UNUSED,
a06ea964
NC		 1660 bfd_reloc_code_real_type code)
1661{
a6bb11b2 1662 reloc_howto_type *howto = elfNN_aarch64_howto_from_bfd_reloc (code);
a06ea964 1663
a6bb11b2
YZ		 1664 if (howto != NULL)
1665 return howto;
a06ea964
NC		 1666
1667 bfd_set_error (bfd_error_bad_value);
1668 return NULL;
1669}
1670
1671static reloc_howto_type *
cec5225b 1672elfNN_aarch64_reloc_name_lookup (bfd *abfd ATTRIBUTE_UNUSED,
a06ea964
NC		 1673 const char *r_name)
1674{
1675 unsigned int i;
1676
a6bb11b2
YZ		 1677 for (i = 1; i < ARRAY_SIZE (elfNN_aarch64_howto_table) - 1; ++i)
1678 if (elfNN_aarch64_howto_table[i].name != NULL
1679 && strcasecmp (elfNN_aarch64_howto_table[i].name, r_name) == 0)
1680 return &elfNN_aarch64_howto_table[i];
a06ea964
NC		 1681
1682 return NULL;
1683}
1684
6d00b590 1685#define TARGET_LITTLE_SYM aarch64_elfNN_le_vec
cec5225b 1686#define TARGET_LITTLE_NAME "elfNN-littleaarch64"
6d00b590 1687#define TARGET_BIG_SYM aarch64_elfNN_be_vec
cec5225b 1688#define TARGET_BIG_NAME "elfNN-bigaarch64"
a06ea964 1689
a06ea964
NC		 1690/* The linker script knows the section names for placement.
1691 The entry_names are used to do simple name mangling on the stubs.
1692 Given a function name, and its type, the stub can be found. The
1693 name can be changed. The only requirement is the %s be present. */
1694#define STUB_ENTRY_NAME "__%s_veneer"
1695
1696/* The name of the dynamic interpreter. This is put in the .interp
1697 section. */
1698#define ELF_DYNAMIC_INTERPRETER "/lib/ld.so.1"
1699
1700#define AARCH64_MAX_FWD_BRANCH_OFFSET \
1701 (((1 << 25) - 1) << 2)
1702#define AARCH64_MAX_BWD_BRANCH_OFFSET \
1703 (-((1 << 25) << 2))
1704
1705#define AARCH64_MAX_ADRP_IMM ((1 << 20) - 1)
1706#define AARCH64_MIN_ADRP_IMM (-(1 << 20))
1707
1708static int
1709aarch64_valid_for_adrp_p (bfd_vma value, bfd_vma place)
1710{
1711 bfd_signed_vma offset = (bfd_signed_vma) (PG (value) - PG (place)) >> 12;
1712 return offset <= AARCH64_MAX_ADRP_IMM && offset >= AARCH64_MIN_ADRP_IMM;
1713}
1714
1715static int
1716aarch64_valid_branch_p (bfd_vma value, bfd_vma place)
1717{
1718 bfd_signed_vma offset = (bfd_signed_vma) (value - place);
1719 return (offset <= AARCH64_MAX_FWD_BRANCH_OFFSET
1720 && offset >= AARCH64_MAX_BWD_BRANCH_OFFSET);
1721}
1722
1723static const uint32_t aarch64_adrp_branch_stub [] =
1724{
1725 0x90000010, /* adrp ip0, X */
1726 /* R_AARCH64_ADR_HI21_PCREL(X) */
1727 0x91000210, /* add ip0, ip0, :lo12:X */
1728 /* R_AARCH64_ADD_ABS_LO12_NC(X) */
1729 0xd61f0200, /* br ip0 */
1730};
1731
1732static const uint32_t aarch64_long_branch_stub[] =
1733{
cec5225b 1734#if ARCH_SIZE == 64
a06ea964 1735 0x58000090, /* ldr ip0, 1f */
cec5225b
YZ		 1736#else
1737 0x18000090, /* ldr wip0, 1f */
1738#endif
a06ea964
NC		 1739 0x10000011, /* adr ip1, #0 */
1740 0x8b110210, /* add ip0, ip0, ip1 */
1741 0xd61f0200, /* br ip0 */
cec5225b
YZ		 1742 0x00000000, /* 1: .xword or .word
1743 R_AARCH64_PRELNN(X) + 12
a06ea964
NC		 1744 */
1745 0x00000000,
1746};
1747
68fcca92
JW		 1748static const uint32_t aarch64_erratum_835769_stub[] =
1749{
1750 0x00000000, /* Placeholder for multiply accumulate. */
1751 0x14000000, /* b <label> */
1752};
1753
4106101c
MS		 1754static const uint32_t aarch64_erratum_843419_stub[] =
1755{
1756 0x00000000, /* Placeholder for LDR instruction. */
1757 0x14000000, /* b <label> */
1758};
1759
a06ea964
NC		 1760/* Section name for stubs is the associated section name plus this
1761 string. */
1762#define STUB_SUFFIX ".stub"
1763
cec5225b 1764enum elf_aarch64_stub_type
a06ea964
NC		 1765{
1766 aarch64_stub_none,
1767 aarch64_stub_adrp_branch,
1768 aarch64_stub_long_branch,
68fcca92 1769 aarch64_stub_erratum_835769_veneer,
4106101c 1770 aarch64_stub_erratum_843419_veneer,
a06ea964
NC		 1771};
1772
cec5225b 1773struct elf_aarch64_stub_hash_entry
a06ea964
NC		 1774{
1775 /* Base hash table entry structure. */
1776 struct bfd_hash_entry root;
1777
1778 /* The stub section. */
1779 asection *stub_sec;
1780
1781 /* Offset within stub_sec of the beginning of this stub. */
1782 bfd_vma stub_offset;
1783
1784 /* Given the symbol's value and its section we can determine its final
1785 value when building the stubs (so the stub knows where to jump). */
1786 bfd_vma target_value;
1787 asection *target_section;
1788
cec5225b 1789 enum elf_aarch64_stub_type stub_type;
a06ea964
NC		 1790
1791 /* The symbol table entry, if any, that this was derived from. */
cec5225b 1792 struct elf_aarch64_link_hash_entry *h;
a06ea964
NC		 1793
1794 /* Destination symbol type */
1795 unsigned char st_type;
1796
1797 /* Where this stub is being called from, or, in the case of combined
1798 stub sections, the first input section in the group. */
1799 asection *id_sec;
1800
1801 /* The name for the local symbol at the start of this stub. The
1802 stub name in the hash table has to be unique; this does not, so
1803 it can be friendlier. */
1804 char *output_name;
68fcca92
JW		 1805
1806 /* The instruction which caused this stub to be generated (only valid for
1807 erratum 835769 workaround stubs at present). */
1808 uint32_t veneered_insn;
4106101c
MS		 1809
1810 /* In an erratum 843419 workaround stub, the ADRP instruction offset. */
1811 bfd_vma adrp_offset;
a06ea964
NC		 1812};
1813
1814/* Used to build a map of a section. This is required for mixed-endian
1815 code/data. */
1816
cec5225b 1817typedef struct elf_elf_section_map
a06ea964
NC		 1818{
1819 bfd_vma vma;
1820 char type;
1821}
cec5225b 1822elf_aarch64_section_map;
a06ea964
NC		 1823
1824
1825typedef struct _aarch64_elf_section_data
1826{
1827 struct bfd_elf_section_data elf;
1828 unsigned int mapcount;
1829 unsigned int mapsize;
cec5225b 1830 elf_aarch64_section_map *map;
a06ea964
NC		 1831}
1832_aarch64_elf_section_data;
1833
cec5225b 1834#define elf_aarch64_section_data(sec) \
a06ea964
NC		 1835 ((_aarch64_elf_section_data *) elf_section_data (sec))
1836
4e8516b2
AP		 1837/* The size of the thread control block which is defined to be two pointers. */
1838#define TCB_SIZE (ARCH_SIZE/8)*2
a06ea964
NC		 1839
1840struct elf_aarch64_local_symbol
1841{
1842 unsigned int got_type;
1843 bfd_signed_vma got_refcount;
1844 bfd_vma got_offset;
1845
1846 /* Offset of the GOTPLT entry reserved for the TLS descriptor. The
1847 offset is from the end of the jump table and reserved entries
1848 within the PLTGOT.
1849
1850 The magic value (bfd_vma) -1 indicates that an offset has not be
1851 allocated. */
1852 bfd_vma tlsdesc_got_jump_table_offset;
1853};
1854
1855struct elf_aarch64_obj_tdata
1856{
1857 struct elf_obj_tdata root;
1858
1859 /* local symbol descriptors */
1860 struct elf_aarch64_local_symbol *locals;
1861
1862 /* Zero to warn when linking objects with incompatible enum sizes. */
1863 int no_enum_size_warning;
1864
1865 /* Zero to warn when linking objects with incompatible wchar_t sizes. */
1866 int no_wchar_size_warning;
1867};
1868
1869#define elf_aarch64_tdata(bfd) \
1870 ((struct elf_aarch64_obj_tdata *) (bfd)->tdata.any)
1871
cec5225b 1872#define elf_aarch64_locals(bfd) (elf_aarch64_tdata (bfd)->locals)
a06ea964
NC		 1873
1874#define is_aarch64_elf(bfd) \
1875 (bfd_get_flavour (bfd) == bfd_target_elf_flavour \
1876 && elf_tdata (bfd) != NULL \
1877 && elf_object_id (bfd) == AARCH64_ELF_DATA)
1878
1879static bfd_boolean
cec5225b 1880elfNN_aarch64_mkobject (bfd *abfd)
a06ea964
NC		 1881{
1882 return bfd_elf_allocate_object (abfd, sizeof (struct elf_aarch64_obj_tdata),
1883 AARCH64_ELF_DATA);
1884}
1885
cec5225b
YZ		 1886#define elf_aarch64_hash_entry(ent) \
1887 ((struct elf_aarch64_link_hash_entry *)(ent))
a06ea964
NC		 1888
1889#define GOT_UNKNOWN 0
1890#define GOT_NORMAL 1
1891#define GOT_TLS_GD 2
1892#define GOT_TLS_IE 4
1893#define GOT_TLSDESC_GD 8
1894
1895#define GOT_TLS_GD_ANY_P(type) ((type & GOT_TLS_GD) || (type & GOT_TLSDESC_GD))
1896
1897/* AArch64 ELF linker hash entry. */
cec5225b 1898struct elf_aarch64_link_hash_entry
a06ea964
NC		 1899{
1900 struct elf_link_hash_entry root;
1901
1902 /* Track dynamic relocs copied for this symbol. */
1903 struct elf_dyn_relocs *dyn_relocs;
1904
a06ea964
NC		 1905 /* Since PLT entries have variable size, we need to record the
1906 index into .got.plt instead of recomputing it from the PLT
1907 offset. */
1908 bfd_signed_vma plt_got_offset;
1909
1910 /* Bit mask representing the type of GOT entry(s) if any required by
1911 this symbol. */
1912 unsigned int got_type;
1913
1914 /* A pointer to the most recently used stub hash entry against this
1915 symbol. */
cec5225b 1916 struct elf_aarch64_stub_hash_entry *stub_cache;
a06ea964
NC		 1917
1918 /* Offset of the GOTPLT entry reserved for the TLS descriptor. The offset
1919 is from the end of the jump table and reserved entries within the PLTGOT.
1920
1921 The magic value (bfd_vma) -1 indicates that an offset has not
1922 be allocated. */
1923 bfd_vma tlsdesc_got_jump_table_offset;
1924};
1925
1926static unsigned int
cec5225b 1927elfNN_aarch64_symbol_got_type (struct elf_link_hash_entry *h,
a06ea964
NC		 1928 bfd *abfd,
1929 unsigned long r_symndx)
1930{
1931 if (h)
cec5225b 1932 return elf_aarch64_hash_entry (h)->got_type;
a06ea964 1933
cec5225b 1934 if (! elf_aarch64_locals (abfd))
a06ea964
NC		 1935 return GOT_UNKNOWN;
1936
cec5225b 1937 return elf_aarch64_locals (abfd)[r_symndx].got_type;
a06ea964
NC		 1938}
1939
a06ea964 1940/* Get the AArch64 elf linker hash table from a link_info structure. */
cec5225b
YZ		 1941#define elf_aarch64_hash_table(info) \
1942 ((struct elf_aarch64_link_hash_table *) ((info)->hash))
a06ea964
NC		 1943
1944#define aarch64_stub_hash_lookup(table, string, create, copy) \
cec5225b 1945 ((struct elf_aarch64_stub_hash_entry *) \
a06ea964
NC		 1946 bfd_hash_lookup ((table), (string), (create), (copy)))
1947
1948/* AArch64 ELF linker hash table. */
cec5225b 1949struct elf_aarch64_link_hash_table
a06ea964
NC		 1950{
1951 /* The main hash table. */
1952 struct elf_link_hash_table root;
1953
1954 /* Nonzero to force PIC branch veneers. */
1955 int pic_veneer;
1956
68fcca92
JW		 1957 /* Fix erratum 835769. */
1958 int fix_erratum_835769;
1959
4106101c
MS		 1960 /* Fix erratum 843419. */
1961 int fix_erratum_843419;
1962
1963 /* Enable ADRP->ADR rewrite for erratum 843419 workaround. */
1964 int fix_erratum_843419_adr;
1965
a06ea964
NC		 1966 /* The number of bytes in the initial entry in the PLT. */
1967 bfd_size_type plt_header_size;
1968
1969 /* The number of bytes in the subsequent PLT etries. */
1970 bfd_size_type plt_entry_size;
1971
1972 /* Short-cuts to get to dynamic linker sections. */
1973 asection *sdynbss;
1974 asection *srelbss;
1975
1976 /* Small local sym cache. */
1977 struct sym_cache sym_cache;
1978
1979 /* For convenience in allocate_dynrelocs. */
1980 bfd *obfd;
1981
1982 /* The amount of space used by the reserved portion of the sgotplt
1983 section, plus whatever space is used by the jump slots. */
1984 bfd_vma sgotplt_jump_table_size;
1985
1986 /* The stub hash table. */
1987 struct bfd_hash_table stub_hash_table;
1988
1989 /* Linker stub bfd. */
1990 bfd *stub_bfd;
1991
1992 /* Linker call-backs. */
1993 asection *(*add_stub_section) (const char *, asection *);
1994 void (*layout_sections_again) (void);
1995
1996 /* Array to keep track of which stub sections have been created, and
1997 information on stub grouping. */
1998 struct map_stub
1999 {
2000 /* This is the section to which stubs in the group will be
2001 attached. */
2002 asection *link_sec;
2003 /* The stub section. */
2004 asection *stub_sec;
2005 } *stub_group;
2006
cec5225b 2007 /* Assorted information used by elfNN_aarch64_size_stubs. */
a06ea964
NC		 2008 unsigned int bfd_count;
2009 int top_index;
2010 asection **input_list;
2011
2012 /* The offset into splt of the PLT entry for the TLS descriptor
2013 resolver. Special values are 0, if not necessary (or not found
2014 to be necessary yet), and -1 if needed but not determined
2015 yet. */
2016 bfd_vma tlsdesc_plt;
2017
2018 /* The GOT offset for the lazy trampoline. Communicated to the
2019 loader via DT_TLSDESC_GOT. The magic value (bfd_vma) -1
2020 indicates an offset is not allocated. */
2021 bfd_vma dt_tlsdesc_got;
1419bbe5
WN		 2022
2023 /* Used by local STT_GNU_IFUNC symbols. */
2024 htab_t loc_hash_table;
2025 void * loc_hash_memory;
a06ea964
NC		 2026};
2027
a06ea964
NC		 2028/* Create an entry in an AArch64 ELF linker hash table. */
2029
2030static struct bfd_hash_entry *
cec5225b 2031elfNN_aarch64_link_hash_newfunc (struct bfd_hash_entry *entry,
a06ea964
NC		 2032 struct bfd_hash_table *table,
2033 const char *string)
2034{
cec5225b
YZ		 2035 struct elf_aarch64_link_hash_entry *ret =
2036 (struct elf_aarch64_link_hash_entry *) entry;
a06ea964
NC		 2037
2038 /* Allocate the structure if it has not already been allocated by a
2039 subclass. */
2040 if (ret == NULL)
2041 ret = bfd_hash_allocate (table,
cec5225b 2042 sizeof (struct elf_aarch64_link_hash_entry));
a06ea964
NC		 2043 if (ret == NULL)
2044 return (struct bfd_hash_entry *) ret;
2045
2046 /* Call the allocation method of the superclass. */
cec5225b 2047 ret = ((struct elf_aarch64_link_hash_entry *)
a06ea964
NC		 2048 _bfd_elf_link_hash_newfunc ((struct bfd_hash_entry *) ret,
2049 table, string));
2050 if (ret != NULL)
2051 {
2052 ret->dyn_relocs = NULL;
a06ea964
NC		 2053 ret->got_type = GOT_UNKNOWN;
2054 ret->plt_got_offset = (bfd_vma) - 1;
2055 ret->stub_cache = NULL;
2056 ret->tlsdesc_got_jump_table_offset = (bfd_vma) - 1;
2057 }
2058
2059 return (struct bfd_hash_entry *) ret;
2060}
2061
2062/* Initialize an entry in the stub hash table. */
2063
2064static struct bfd_hash_entry *
2065stub_hash_newfunc (struct bfd_hash_entry *entry,
2066 struct bfd_hash_table *table, const char *string)
2067{
2068 /* Allocate the structure if it has not already been allocated by a
2069 subclass. */
2070 if (entry == NULL)
2071 {
2072 entry = bfd_hash_allocate (table,
2073 sizeof (struct
cec5225b 2074 elf_aarch64_stub_hash_entry));
a06ea964
NC		 2075 if (entry == NULL)
2076 return entry;
2077 }
2078
2079 /* Call the allocation method of the superclass. */
2080 entry = bfd_hash_newfunc (entry, table, string);
2081 if (entry != NULL)
2082 {
cec5225b 2083 struct elf_aarch64_stub_hash_entry *eh;
a06ea964
NC		 2084
2085 /* Initialize the local fields. */
cec5225b 2086 eh = (struct elf_aarch64_stub_hash_entry *) entry;
4106101c 2087 eh->adrp_offset = 0;
a06ea964
NC		 2088 eh->stub_sec = NULL;
2089 eh->stub_offset = 0;
2090 eh->target_value = 0;
2091 eh->target_section = NULL;
2092 eh->stub_type = aarch64_stub_none;
2093 eh->h = NULL;
2094 eh->id_sec = NULL;
2095 }
2096
2097 return entry;
2098}
2099
1419bbe5
WN		 2100/* Compute a hash of a local hash entry. We use elf_link_hash_entry
2101 for local symbol so that we can handle local STT_GNU_IFUNC symbols
2102 as global symbol. We reuse indx and dynstr_index for local symbol
2103 hash since they aren't used by global symbols in this backend. */
2104
2105static hashval_t
2106elfNN_aarch64_local_htab_hash (const void *ptr)
2107{
2108 struct elf_link_hash_entry *h
2109 = (struct elf_link_hash_entry *) ptr;
2110 return ELF_LOCAL_SYMBOL_HASH (h->indx, h->dynstr_index);
2111}
2112
2113/* Compare local hash entries. */
2114
2115static int
2116elfNN_aarch64_local_htab_eq (const void *ptr1, const void *ptr2)
2117{
2118 struct elf_link_hash_entry *h1
2119 = (struct elf_link_hash_entry *) ptr1;
2120 struct elf_link_hash_entry *h2
2121 = (struct elf_link_hash_entry *) ptr2;
2122
2123 return h1->indx == h2->indx && h1->dynstr_index == h2->dynstr_index;
2124}
2125
2126/* Find and/or create a hash entry for local symbol. */
2127
2128static struct elf_link_hash_entry *
2129elfNN_aarch64_get_local_sym_hash (struct elf_aarch64_link_hash_table *htab,
2130 bfd *abfd, const Elf_Internal_Rela *rel,
2131 bfd_boolean create)
2132{
2133 struct elf_aarch64_link_hash_entry e, *ret;
2134 asection *sec = abfd->sections;
2135 hashval_t h = ELF_LOCAL_SYMBOL_HASH (sec->id,
2136 ELFNN_R_SYM (rel->r_info));
2137 void **slot;
2138
2139 e.root.indx = sec->id;
2140 e.root.dynstr_index = ELFNN_R_SYM (rel->r_info);
2141 slot = htab_find_slot_with_hash (htab->loc_hash_table, &e, h,
2142 create ? INSERT : NO_INSERT);
2143
2144 if (!slot)
2145 return NULL;
2146
2147 if (*slot)
2148 {
2149 ret = (struct elf_aarch64_link_hash_entry *) *slot;
2150 return &ret->root;
2151 }
2152
2153 ret = (struct elf_aarch64_link_hash_entry *)
2154 objalloc_alloc ((struct objalloc *) htab->loc_hash_memory,
2155 sizeof (struct elf_aarch64_link_hash_entry));
2156 if (ret)
2157 {
2158 memset (ret, 0, sizeof (*ret));
2159 ret->root.indx = sec->id;
2160 ret->root.dynstr_index = ELFNN_R_SYM (rel->r_info);
2161 ret->root.dynindx = -1;
2162 *slot = ret;
2163 }
2164 return &ret->root;
2165}
a06ea964
NC		 2166
2167/* Copy the extra info we tack onto an elf_link_hash_entry. */
2168
2169static void
cec5225b 2170elfNN_aarch64_copy_indirect_symbol (struct bfd_link_info *info,
a06ea964
NC		 2171 struct elf_link_hash_entry *dir,
2172 struct elf_link_hash_entry *ind)
2173{
cec5225b 2174 struct elf_aarch64_link_hash_entry *edir, *eind;
a06ea964 2175
cec5225b
YZ		 2176 edir = (struct elf_aarch64_link_hash_entry *) dir;
2177 eind = (struct elf_aarch64_link_hash_entry *) ind;
a06ea964
NC		 2178
2179 if (eind->dyn_relocs != NULL)
2180 {
2181 if (edir->dyn_relocs != NULL)
2182 {
2183 struct elf_dyn_relocs **pp;
2184 struct elf_dyn_relocs *p;
2185
2186 /* Add reloc counts against the indirect sym to the direct sym
2187 list. Merge any entries against the same section. */
2188 for (pp = &eind->dyn_relocs; (p = *pp) != NULL;)
2189 {
2190 struct elf_dyn_relocs *q;
2191
2192 for (q = edir->dyn_relocs; q != NULL; q = q->next)
2193 if (q->sec == p->sec)
2194 {
2195 q->pc_count += p->pc_count;
2196 q->count += p->count;
2197 *pp = p->next;
2198 break;
2199 }
2200 if (q == NULL)
2201 pp = &p->next;
2202 }
2203 *pp = edir->dyn_relocs;
2204 }
2205
2206 edir->dyn_relocs = eind->dyn_relocs;
2207 eind->dyn_relocs = NULL;
2208 }
2209
a06ea964
NC		 2210 if (ind->root.type == bfd_link_hash_indirect)
2211 {
2212 /* Copy over PLT info. */
2213 if (dir->got.refcount <= 0)
2214 {
2215 edir->got_type = eind->got_type;
2216 eind->got_type = GOT_UNKNOWN;
2217 }
2218 }
2219
2220 _bfd_elf_link_hash_copy_indirect (info, dir, ind);
2221}
2222
68faa637
AM		 2223/* Destroy an AArch64 elf linker hash table. */
2224
2225static void
d495ab0d 2226elfNN_aarch64_link_hash_table_free (bfd *obfd)
68faa637
AM		 2227{
2228 struct elf_aarch64_link_hash_table *ret
d495ab0d 2229 = (struct elf_aarch64_link_hash_table *) obfd->link.hash;
68faa637
AM		 2230
2231 if (ret->loc_hash_table)
2232 htab_delete (ret->loc_hash_table);
2233 if (ret->loc_hash_memory)
2234 objalloc_free ((struct objalloc *) ret->loc_hash_memory);
2235
2236 bfd_hash_table_free (&ret->stub_hash_table);
d495ab0d 2237 _bfd_elf_link_hash_table_free (obfd);
68faa637
AM		 2238}
2239
a06ea964
NC		 2240/* Create an AArch64 elf linker hash table. */
2241
2242static struct bfd_link_hash_table *
cec5225b 2243elfNN_aarch64_link_hash_table_create (bfd *abfd)
a06ea964 2244{
cec5225b
YZ		 2245 struct elf_aarch64_link_hash_table *ret;
2246 bfd_size_type amt = sizeof (struct elf_aarch64_link_hash_table);
a06ea964 2247
7bf52ea2 2248 ret = bfd_zmalloc (amt);
a06ea964
NC		 2249 if (ret == NULL)
2250 return NULL;
2251
2252 if (!_bfd_elf_link_hash_table_init
cec5225b
YZ		 2253 (&ret->root, abfd, elfNN_aarch64_link_hash_newfunc,
2254 sizeof (struct elf_aarch64_link_hash_entry), AARCH64_ELF_DATA))
a06ea964
NC		 2255 {
2256 free (ret);
2257 return NULL;
2258 }
2259
a06ea964
NC		 2260 ret->plt_header_size = PLT_ENTRY_SIZE;
2261 ret->plt_entry_size = PLT_SMALL_ENTRY_SIZE;
a06ea964 2262 ret->obfd = abfd;
a06ea964
NC		 2263 ret->dt_tlsdesc_got = (bfd_vma) - 1;
2264
2265 if (!bfd_hash_table_init (&ret->stub_hash_table, stub_hash_newfunc,
cec5225b 2266 sizeof (struct elf_aarch64_stub_hash_entry)))
a06ea964 2267 {
d495ab0d 2268 _bfd_elf_link_hash_table_free (abfd);
a06ea964
NC		 2269 return NULL;
2270 }
2271
1419bbe5
WN		 2272 ret->loc_hash_table = htab_try_create (1024,
2273 elfNN_aarch64_local_htab_hash,
2274 elfNN_aarch64_local_htab_eq,
2275 NULL);
2276 ret->loc_hash_memory = objalloc_create ();
2277 if (!ret->loc_hash_table || !ret->loc_hash_memory)
2278 {
d495ab0d 2279 elfNN_aarch64_link_hash_table_free (abfd);
1419bbe5
WN		 2280 return NULL;
2281 }
d495ab0d 2282 ret->root.root.hash_table_free = elfNN_aarch64_link_hash_table_free;
1419bbe5 2283
a06ea964
NC		 2284 return &ret->root.root;
2285}
2286
a06ea964
NC		 2287static bfd_boolean
2288aarch64_relocate (unsigned int r_type, bfd *input_bfd, asection *input_section,
2289 bfd_vma offset, bfd_vma value)
2290{
2291 reloc_howto_type *howto;
2292 bfd_vma place;
2293
cec5225b 2294 howto = elfNN_aarch64_howto_from_type (r_type);
a06ea964
NC		 2295 place = (input_section->output_section->vma + input_section->output_offset
2296 + offset);
caed7120
YZ		 2297
2298 r_type = elfNN_aarch64_bfd_reloc_from_type (r_type);
2299 value = _bfd_aarch64_elf_resolve_relocation (r_type, place, value, 0, FALSE);
2300 return _bfd_aarch64_elf_put_addend (input_bfd,
2301 input_section->contents + offset, r_type,
2302 howto, value);
a06ea964
NC		 2303}
2304
cec5225b 2305static enum elf_aarch64_stub_type
a06ea964
NC		 2306aarch64_select_branch_stub (bfd_vma value, bfd_vma place)
2307{
2308 if (aarch64_valid_for_adrp_p (value, place))
2309 return aarch64_stub_adrp_branch;
2310 return aarch64_stub_long_branch;
2311}
2312
2313/* Determine the type of stub needed, if any, for a call. */
2314
cec5225b 2315static enum elf_aarch64_stub_type
a06ea964
NC		 2316aarch64_type_of_stub (struct bfd_link_info *info,
2317 asection *input_sec,
2318 const Elf_Internal_Rela *rel,
2319 unsigned char st_type,
cec5225b 2320 struct elf_aarch64_link_hash_entry *hash,
a06ea964
NC		 2321 bfd_vma destination)
2322{
2323 bfd_vma location;
2324 bfd_signed_vma branch_offset;
2325 unsigned int r_type;
cec5225b
YZ		 2326 struct elf_aarch64_link_hash_table *globals;
2327 enum elf_aarch64_stub_type stub_type = aarch64_stub_none;
a06ea964
NC		 2328 bfd_boolean via_plt_p;
2329
2330 if (st_type != STT_FUNC)
2331 return stub_type;
2332
cec5225b 2333 globals = elf_aarch64_hash_table (info);
a06ea964
NC		 2334 via_plt_p = (globals->root.splt != NULL && hash != NULL
2335 && hash->root.plt.offset != (bfd_vma) - 1);
2336
2337 if (via_plt_p)
2338 return stub_type;
2339
2340 /* Determine where the call point is. */
2341 location = (input_sec->output_offset
2342 + input_sec->output_section->vma + rel->r_offset);
2343
2344 branch_offset = (bfd_signed_vma) (destination - location);
2345
cec5225b 2346 r_type = ELFNN_R_TYPE (rel->r_info);
a06ea964
NC		 2347
2348 /* We don't want to redirect any old unconditional jump in this way,
2349 only one which is being used for a sibcall, where it is
2350 acceptable for the IP0 and IP1 registers to be clobbered. */
a6bb11b2 2351 if ((r_type == AARCH64_R (CALL26) || r_type == AARCH64_R (JUMP26))
a06ea964
NC		 2352 && (branch_offset > AARCH64_MAX_FWD_BRANCH_OFFSET
2353 || branch_offset < AARCH64_MAX_BWD_BRANCH_OFFSET))
2354 {
2355 stub_type = aarch64_stub_long_branch;
2356 }
2357
2358 return stub_type;
2359}
2360
2361/* Build a name for an entry in the stub hash table. */
2362
2363static char *
cec5225b 2364elfNN_aarch64_stub_name (const asection *input_section,
a06ea964 2365 const asection *sym_sec,
cec5225b 2366 const struct elf_aarch64_link_hash_entry *hash,
a06ea964
NC		 2367 const Elf_Internal_Rela *rel)
2368{
2369 char *stub_name;
2370 bfd_size_type len;
2371
2372 if (hash)
2373 {
2374 len = 8 + 1 + strlen (hash->root.root.root.string) + 1 + 16 + 1;
2375 stub_name = bfd_malloc (len);
2376 if (stub_name != NULL)
2377 snprintf (stub_name, len, "%08x_%s+%" BFD_VMA_FMT "x",
2378 (unsigned int) input_section->id,
2379 hash->root.root.root.string,
2380 rel->r_addend);
2381 }
2382 else
2383 {
2384 len = 8 + 1 + 8 + 1 + 8 + 1 + 16 + 1;
2385 stub_name = bfd_malloc (len);
2386 if (stub_name != NULL)
2387 snprintf (stub_name, len, "%08x_%x:%x+%" BFD_VMA_FMT "x",
2388 (unsigned int) input_section->id,
2389 (unsigned int) sym_sec->id,
cec5225b 2390 (unsigned int) ELFNN_R_SYM (rel->r_info),
a06ea964
NC		 2391 rel->r_addend);
2392 }
2393
2394 return stub_name;
2395}
2396
2397/* Look up an entry in the stub hash. Stub entries are cached because
2398 creating the stub name takes a bit of time. */
2399
cec5225b
YZ		 2400static struct elf_aarch64_stub_hash_entry *
2401elfNN_aarch64_get_stub_entry (const asection *input_section,
a06ea964
NC		 2402 const asection *sym_sec,
2403 struct elf_link_hash_entry *hash,
2404 const Elf_Internal_Rela *rel,
cec5225b 2405 struct elf_aarch64_link_hash_table *htab)
a06ea964 2406{
cec5225b
YZ		 2407 struct elf_aarch64_stub_hash_entry *stub_entry;
2408 struct elf_aarch64_link_hash_entry *h =
2409 (struct elf_aarch64_link_hash_entry *) hash;
a06ea964
NC		 2410 const asection *id_sec;
2411
2412 if ((input_section->flags & SEC_CODE) == 0)
2413 return NULL;
2414
2415 /* If this input section is part of a group of sections sharing one
2416 stub section, then use the id of the first section in the group.
2417 Stub names need to include a section id, as there may well be
2418 more than one stub used to reach say, printf, and we need to
2419 distinguish between them. */
2420 id_sec = htab->stub_group[input_section->id].link_sec;
2421
2422 if (h != NULL && h->stub_cache != NULL
2423 && h->stub_cache->h == h && h->stub_cache->id_sec == id_sec)
2424 {
2425 stub_entry = h->stub_cache;
2426 }
2427 else
2428 {
2429 char *stub_name;
2430
cec5225b 2431 stub_name = elfNN_aarch64_stub_name (id_sec, sym_sec, h, rel);
a06ea964
NC		 2432 if (stub_name == NULL)
2433 return NULL;
2434
2435 stub_entry = aarch64_stub_hash_lookup (&htab->stub_hash_table,
2436 stub_name, FALSE, FALSE);
2437 if (h != NULL)
2438 h->stub_cache = stub_entry;
2439
2440 free (stub_name);
2441 }
2442
2443 return stub_entry;
2444}
2445
a06ea964 2446
66585675
MS		 2447/* Create a stub section. */
2448
2449static asection *
2450_bfd_aarch64_create_stub_section (asection *section,
2451 struct elf_aarch64_link_hash_table *htab)
2452{
2453 size_t namelen;
2454 bfd_size_type len;
2455 char *s_name;
2456
2457 namelen = strlen (section->name);
2458 len = namelen + sizeof (STUB_SUFFIX);
2459 s_name = bfd_alloc (htab->stub_bfd, len);
2460 if (s_name == NULL)
2461 return NULL;
2462
2463 memcpy (s_name, section->name, namelen);
2464 memcpy (s_name + namelen, STUB_SUFFIX, sizeof (STUB_SUFFIX));
2465 return (*htab->add_stub_section) (s_name, section);
2466}
2467
2468
fc6d53be
MS		 2469/* Find or create a stub section for a link section.
2470
2471 Fix or create the stub section used to collect stubs attached to
2472 the specified link section. */
2473
2474static asection *
2475_bfd_aarch64_get_stub_for_link_section (asection *link_section,
2476 struct elf_aarch64_link_hash_table *htab)
2477{
2478 if (htab->stub_group[link_section->id].stub_sec == NULL)
2479 htab->stub_group[link_section->id].stub_sec
2480 = _bfd_aarch64_create_stub_section (link_section, htab);
2481 return htab->stub_group[link_section->id].stub_sec;
2482}
2483
2484
ef857521
MS		 2485/* Find or create a stub section in the stub group for an input
2486 section. */
2487
2488static asection *
2489_bfd_aarch64_create_or_find_stub_sec (asection *section,
2490 struct elf_aarch64_link_hash_table *htab)
a06ea964 2491{
fc6d53be
MS		 2492 asection *link_sec = htab->stub_group[section->id].link_sec;
2493 return _bfd_aarch64_get_stub_for_link_section (link_sec, htab);
ef857521
MS		 2494}
2495
2496
2497/* Add a new stub entry in the stub group associated with an input
2498 section to the stub hash. Not all fields of the new stub entry are
2499 initialised. */
2500
2501static struct elf_aarch64_stub_hash_entry *
2502_bfd_aarch64_add_stub_entry_in_group (const char *stub_name,
2503 asection *section,
2504 struct elf_aarch64_link_hash_table *htab)
2505{
2506 asection *link_sec;
2507 asection *stub_sec;
2508 struct elf_aarch64_stub_hash_entry *stub_entry;
2509
2510 link_sec = htab->stub_group[section->id].link_sec;
2511 stub_sec = _bfd_aarch64_create_or_find_stub_sec (section, htab);
2512
a06ea964
NC		 2513 /* Enter this entry into the linker stub hash table. */
2514 stub_entry = aarch64_stub_hash_lookup (&htab->stub_hash_table, stub_name,
2515 TRUE, FALSE);
2516 if (stub_entry == NULL)
2517 {
2518 (*_bfd_error_handler) (_("%s: cannot create stub entry %s"),
2519 section->owner, stub_name);
2520 return NULL;
2521 }
2522
2523 stub_entry->stub_sec = stub_sec;
2524 stub_entry->stub_offset = 0;
2525 stub_entry->id_sec = link_sec;
2526
2527 return stub_entry;
2528}
2529
4106101c
MS		 2530/* Add a new stub entry in the final stub section to the stub hash.
2531 Not all fields of the new stub entry are initialised. */
2532
2533static struct elf_aarch64_stub_hash_entry *
2534_bfd_aarch64_add_stub_entry_after (const char *stub_name,
2535 asection *link_section,
2536 struct elf_aarch64_link_hash_table *htab)
2537{
2538 asection *stub_sec;
2539 struct elf_aarch64_stub_hash_entry *stub_entry;
2540
2541 stub_sec = _bfd_aarch64_get_stub_for_link_section (link_section, htab);
2542 stub_entry = aarch64_stub_hash_lookup (&htab->stub_hash_table, stub_name,
2543 TRUE, FALSE);
2544 if (stub_entry == NULL)
2545 {
2546 (*_bfd_error_handler) (_("cannot create stub entry %s"), stub_name);
2547 return NULL;
2548 }
2549
2550 stub_entry->stub_sec = stub_sec;
2551 stub_entry->stub_offset = 0;
2552 stub_entry->id_sec = link_section;
2553
2554 return stub_entry;
2555}
2556
2557
a06ea964
NC		 2558static bfd_boolean
2559aarch64_build_one_stub (struct bfd_hash_entry *gen_entry,
2560 void *in_arg ATTRIBUTE_UNUSED)
2561{
cec5225b 2562 struct elf_aarch64_stub_hash_entry *stub_entry;
a06ea964
NC		 2563 asection *stub_sec;
2564 bfd *stub_bfd;
2565 bfd_byte *loc;
2566 bfd_vma sym_value;
68fcca92
JW		 2567 bfd_vma veneered_insn_loc;
2568 bfd_vma veneer_entry_loc;
2569 bfd_signed_vma branch_offset = 0;
a06ea964
NC		 2570 unsigned int template_size;
2571 const uint32_t *template;
2572 unsigned int i;
2573
2574 /* Massage our args to the form they really have. */
cec5225b 2575 stub_entry = (struct elf_aarch64_stub_hash_entry *) gen_entry;
a06ea964
NC		 2576
2577 stub_sec = stub_entry->stub_sec;
2578
2579 /* Make a note of the offset within the stubs for this entry. */
2580 stub_entry->stub_offset = stub_sec->size;
2581 loc = stub_sec->contents + stub_entry->stub_offset;
2582
2583 stub_bfd = stub_sec->owner;
2584
2585 /* This is the address of the stub destination. */
2586 sym_value = (stub_entry->target_value
2587 + stub_entry->target_section->output_offset
2588 + stub_entry->target_section->output_section->vma);
2589
2590 if (stub_entry->stub_type == aarch64_stub_long_branch)
2591 {
2592 bfd_vma place = (stub_entry->stub_offset + stub_sec->output_section->vma
2593 + stub_sec->output_offset);
2594
2595 /* See if we can relax the stub. */
2596 if (aarch64_valid_for_adrp_p (sym_value, place))
2597 stub_entry->stub_type = aarch64_select_branch_stub (sym_value, place);
2598 }
2599
2600 switch (stub_entry->stub_type)
2601 {
2602 case aarch64_stub_adrp_branch:
2603 template = aarch64_adrp_branch_stub;
2604 template_size = sizeof (aarch64_adrp_branch_stub);
2605 break;
2606 case aarch64_stub_long_branch:
2607 template = aarch64_long_branch_stub;
2608 template_size = sizeof (aarch64_long_branch_stub);
2609 break;
68fcca92
JW		 2610 case aarch64_stub_erratum_835769_veneer:
2611 template = aarch64_erratum_835769_stub;
2612 template_size = sizeof (aarch64_erratum_835769_stub);
2613 break;
4106101c
MS		 2614 case aarch64_stub_erratum_843419_veneer:
2615 template = aarch64_erratum_843419_stub;
2616 template_size = sizeof (aarch64_erratum_843419_stub);
2617 break;
a06ea964 2618 default:
8e2fe09f 2619 abort ();
a06ea964
NC		 2620 }
2621
2622 for (i = 0; i < (template_size / sizeof template[0]); i++)
2623 {
2624 bfd_putl32 (template[i], loc);
2625 loc += 4;
2626 }
2627
2628 template_size = (template_size + 7) & ~7;
2629 stub_sec->size += template_size;
2630
2631 switch (stub_entry->stub_type)
2632 {
2633 case aarch64_stub_adrp_branch:
a6bb11b2 2634 if (aarch64_relocate (AARCH64_R (ADR_PREL_PG_HI21), stub_bfd, stub_sec,
a06ea964
NC		 2635 stub_entry->stub_offset, sym_value))
2636 /* The stub would not have been relaxed if the offset was out
2637 of range. */
2638 BFD_FAIL ();
2639
93ca8569
TB		 2640 if (aarch64_relocate (AARCH64_R (ADD_ABS_LO12_NC), stub_bfd, stub_sec,
2641 stub_entry->stub_offset + 4, sym_value))
2642 BFD_FAIL ();
a06ea964
NC		 2643 break;
2644
2645 case aarch64_stub_long_branch:
2646 /* We want the value relative to the address 12 bytes back from the
2647 value itself. */
93ca8569
TB		 2648 if (aarch64_relocate (AARCH64_R (PRELNN), stub_bfd, stub_sec,
2649 stub_entry->stub_offset + 16, sym_value + 12))
2650 BFD_FAIL ();
a06ea964 2651 break;
68fcca92
JW		 2652
2653 case aarch64_stub_erratum_835769_veneer:
2654 veneered_insn_loc = stub_entry->target_section->output_section->vma
2655 + stub_entry->target_section->output_offset
2656 + stub_entry->target_value;
2657 veneer_entry_loc = stub_entry->stub_sec->output_section->vma
2658 + stub_entry->stub_sec->output_offset
2659 + stub_entry->stub_offset;
2660 branch_offset = veneered_insn_loc - veneer_entry_loc;
2661 branch_offset >>= 2;
2662 branch_offset &= 0x3ffffff;
2663 bfd_putl32 (stub_entry->veneered_insn,
2664 stub_sec->contents + stub_entry->stub_offset);
2665 bfd_putl32 (template[1] | branch_offset,
2666 stub_sec->contents + stub_entry->stub_offset + 4);
2667 break;
2668
4106101c
MS		 2669 case aarch64_stub_erratum_843419_veneer:
2670 if (aarch64_relocate (AARCH64_R (JUMP26), stub_bfd, stub_sec,
2671 stub_entry->stub_offset + 4, sym_value + 4))
2672 BFD_FAIL ();
2673 break;
2674
a06ea964 2675 default:
8e2fe09f 2676 abort ();
a06ea964
NC		 2677 }
2678
2679 return TRUE;
2680}
2681
2682/* As above, but don't actually build the stub. Just bump offset so
2683 we know stub section sizes. */
2684
2685static bfd_boolean
2686aarch64_size_one_stub (struct bfd_hash_entry *gen_entry,
2687 void *in_arg ATTRIBUTE_UNUSED)
2688{
cec5225b 2689 struct elf_aarch64_stub_hash_entry *stub_entry;
a06ea964
NC		 2690 int size;
2691
2692 /* Massage our args to the form they really have. */
cec5225b 2693 stub_entry = (struct elf_aarch64_stub_hash_entry *) gen_entry;
a06ea964
NC		 2694
2695 switch (stub_entry->stub_type)
2696 {
2697 case aarch64_stub_adrp_branch:
2698 size = sizeof (aarch64_adrp_branch_stub);
2699 break;
2700 case aarch64_stub_long_branch:
2701 size = sizeof (aarch64_long_branch_stub);
2702 break;
68fcca92
JW		 2703 case aarch64_stub_erratum_835769_veneer:
2704 size = sizeof (aarch64_erratum_835769_stub);
2705 break;
4106101c
MS		 2706 case aarch64_stub_erratum_843419_veneer:
2707 size = sizeof (aarch64_erratum_843419_stub);
2708 break;
a06ea964 2709 default:
8e2fe09f 2710 abort ();
a06ea964
NC		 2711 }
2712
2713 size = (size + 7) & ~7;
2714 stub_entry->stub_sec->size += size;
2715 return TRUE;
2716}
2717
2718/* External entry points for sizing and building linker stubs. */
2719
2720/* Set up various things so that we can make a list of input sections
2721 for each output section included in the link. Returns -1 on error,
2722 0 when no stubs will be needed, and 1 on success. */
2723
2724int
cec5225b 2725elfNN_aarch64_setup_section_lists (bfd *output_bfd,
a06ea964
NC		 2726 struct bfd_link_info *info)
2727{
2728 bfd *input_bfd;
2729 unsigned int bfd_count;
2730 int top_id, top_index;
2731 asection *section;
2732 asection **input_list, **list;
2733 bfd_size_type amt;
cec5225b
YZ		 2734 struct elf_aarch64_link_hash_table *htab =
2735 elf_aarch64_hash_table (info);
a06ea964
NC		 2736
2737 if (!is_elf_hash_table (htab))
2738 return 0;
2739
2740 /* Count the number of input BFDs and find the top input section id. */
2741 for (input_bfd = info->input_bfds, bfd_count = 0, top_id = 0;
c72f2fb2 2742 input_bfd != NULL; input_bfd = input_bfd->link.next)
a06ea964
NC		 2743 {
2744 bfd_count += 1;
2745 for (section = input_bfd->sections;
2746 section != NULL; section = section->next)
2747 {
2748 if (top_id < section->id)
2749 top_id = section->id;
2750 }
2751 }
2752 htab->bfd_count = bfd_count;
2753
2754 amt = sizeof (struct map_stub) * (top_id + 1);
2755 htab->stub_group = bfd_zmalloc (amt);
2756 if (htab->stub_group == NULL)
2757 return -1;
2758
2759 /* We can't use output_bfd->section_count here to find the top output
2760 section index as some sections may have been removed, and
2761 _bfd_strip_section_from_output doesn't renumber the indices. */
2762 for (section = output_bfd->sections, top_index = 0;
2763 section != NULL; section = section->next)
2764 {
2765 if (top_index < section->index)
2766 top_index = section->index;
2767 }
2768
2769 htab->top_index = top_index;
2770 amt = sizeof (asection *) * (top_index + 1);
2771 input_list = bfd_malloc (amt);
2772 htab->input_list = input_list;
2773 if (input_list == NULL)
2774 return -1;
2775
2776 /* For sections we aren't interested in, mark their entries with a
2777 value we can check later. */
2778 list = input_list + top_index;
2779 do
2780 *list = bfd_abs_section_ptr;
2781 while (list-- != input_list);
2782
2783 for (section = output_bfd->sections;
2784 section != NULL; section = section->next)
2785 {
2786 if ((section->flags & SEC_CODE) != 0)
2787 input_list[section->index] = NULL;
2788 }
2789
2790 return 1;
2791}
2792
cec5225b 2793/* Used by elfNN_aarch64_next_input_section and group_sections. */
a06ea964
NC		 2794#define PREV_SEC(sec) (htab->stub_group[(sec)->id].link_sec)
2795
2796/* The linker repeatedly calls this function for each input section,
2797 in the order that input sections are linked into output sections.
2798 Build lists of input sections to determine groupings between which
2799 we may insert linker stubs. */
2800
2801void
cec5225b 2802elfNN_aarch64_next_input_section (struct bfd_link_info *info, asection *isec)
a06ea964 2803{
cec5225b
YZ		 2804 struct elf_aarch64_link_hash_table *htab =
2805 elf_aarch64_hash_table (info);
a06ea964
NC		 2806
2807 if (isec->output_section->index <= htab->top_index)
2808 {
2809 asection **list = htab->input_list + isec->output_section->index;
2810
2811 if (*list != bfd_abs_section_ptr)
2812 {
2813 /* Steal the link_sec pointer for our list. */
2814 /* This happens to make the list in reverse order,
2815 which is what we want. */
2816 PREV_SEC (isec) = *list;
2817 *list = isec;
2818 }
2819 }
2820}
2821
2822/* See whether we can group stub sections together. Grouping stub
2823 sections may result in fewer stubs. More importantly, we need to
2824 put all .init* and .fini* stubs at the beginning of the .init or
2825 .fini output sections respectively, because glibc splits the
2826 _init and _fini functions into multiple parts. Putting a stub in
2827 the middle of a function is not a good idea. */
2828
2829static void
cec5225b 2830group_sections (struct elf_aarch64_link_hash_table *htab,
a06ea964
NC		 2831 bfd_size_type stub_group_size,
2832 bfd_boolean stubs_always_before_branch)
2833{
2834 asection **list = htab->input_list + htab->top_index;
2835
2836 do
2837 {
2838 asection *tail = *list;
2839
2840 if (tail == bfd_abs_section_ptr)
2841 continue;
2842
2843 while (tail != NULL)
2844 {
2845 asection *curr;
2846 asection *prev;
2847 bfd_size_type total;
2848
2849 curr = tail;
2850 total = tail->size;
2851 while ((prev = PREV_SEC (curr)) != NULL
2852 && ((total += curr->output_offset - prev->output_offset)
2853 < stub_group_size))
2854 curr = prev;
2855
2856 /* OK, the size from the start of CURR to the end is less
2857 than stub_group_size and thus can be handled by one stub
2858 section. (Or the tail section is itself larger than
2859 stub_group_size, in which case we may be toast.)
2860 We should really be keeping track of the total size of
2861 stubs added here, as stubs contribute to the final output
2862 section size. */
2863 do
2864 {
2865 prev = PREV_SEC (tail);
2866 /* Set up this stub group. */
2867 htab->stub_group[tail->id].link_sec = curr;
2868 }
2869 while (tail != curr && (tail = prev) != NULL);
2870
2871 /* But wait, there's more! Input sections up to stub_group_size
2872 bytes before the stub section can be handled by it too. */
2873 if (!stubs_always_before_branch)
2874 {
2875 total = 0;
2876 while (prev != NULL
2877 && ((total += tail->output_offset - prev->output_offset)
2878 < stub_group_size))
2879 {
2880 tail = prev;
2881 prev = PREV_SEC (tail);
2882 htab->stub_group[tail->id].link_sec = curr;
2883 }
2884 }
2885 tail = prev;
2886 }
2887 }
2888 while (list-- != htab->input_list);
2889
2890 free (htab->input_list);
2891}
2892
2893#undef PREV_SEC
2894
68fcca92
JW		 2895#define AARCH64_BITS(x, pos, n) (((x) >> (pos)) & ((1 << (n)) - 1))
2896
2897#define AARCH64_RT(insn) AARCH64_BITS (insn, 0, 5)
2898#define AARCH64_RT2(insn) AARCH64_BITS (insn, 10, 5)
2899#define AARCH64_RA(insn) AARCH64_BITS (insn, 10, 5)
2900#define AARCH64_RD(insn) AARCH64_BITS (insn, 0, 5)
2901#define AARCH64_RN(insn) AARCH64_BITS (insn, 5, 5)
2902#define AARCH64_RM(insn) AARCH64_BITS (insn, 16, 5)
2903
2904#define AARCH64_MAC(insn) (((insn) & 0xff000000) == 0x9b000000)
2905#define AARCH64_BIT(insn, n) AARCH64_BITS (insn, n, 1)
2906#define AARCH64_OP31(insn) AARCH64_BITS (insn, 21, 3)
2907#define AARCH64_ZR 0x1f
2908
2909/* All ld/st ops. See C4-182 of the ARM ARM. The encoding space for
2910 LD_PCREL, LDST_RO, LDST_UI and LDST_UIMM cover prefetch ops. */
2911
2912#define AARCH64_LD(insn) (AARCH64_BIT (insn, 22) == 1)
2913#define AARCH64_LDST(insn) (((insn) & 0x0a000000) == 0x08000000)
2914#define AARCH64_LDST_EX(insn) (((insn) & 0x3f000000) == 0x08000000)
2915#define AARCH64_LDST_PCREL(insn) (((insn) & 0x3b000000) == 0x18000000)
2916#define AARCH64_LDST_NAP(insn) (((insn) & 0x3b800000) == 0x28000000)
2917#define AARCH64_LDSTP_PI(insn) (((insn) & 0x3b800000) == 0x28800000)
2918#define AARCH64_LDSTP_O(insn) (((insn) & 0x3b800000) == 0x29000000)
2919#define AARCH64_LDSTP_PRE(insn) (((insn) & 0x3b800000) == 0x29800000)
2920#define AARCH64_LDST_UI(insn) (((insn) & 0x3b200c00) == 0x38000000)
2921#define AARCH64_LDST_PIIMM(insn) (((insn) & 0x3b200c00) == 0x38000400)
2922#define AARCH64_LDST_U(insn) (((insn) & 0x3b200c00) == 0x38000800)
2923#define AARCH64_LDST_PREIMM(insn) (((insn) & 0x3b200c00) == 0x38000c00)
2924#define AARCH64_LDST_RO(insn) (((insn) & 0x3b200c00) == 0x38200800)
2925#define AARCH64_LDST_UIMM(insn) (((insn) & 0x3b000000) == 0x39000000)
2926#define AARCH64_LDST_SIMD_M(insn) (((insn) & 0xbfbf0000) == 0x0c000000)
2927#define AARCH64_LDST_SIMD_M_PI(insn) (((insn) & 0xbfa00000) == 0x0c800000)
2928#define AARCH64_LDST_SIMD_S(insn) (((insn) & 0xbf9f0000) == 0x0d000000)
2929#define AARCH64_LDST_SIMD_S_PI(insn) (((insn) & 0xbf800000) == 0x0d800000)
2930
3d14faea
MS		 2931/* Classify an INSN if it is indeed a load/store.
2932
2933 Return TRUE if INSN is a LD/ST instruction otherwise return FALSE.
2934
2935 For scalar LD/ST instructions PAIR is FALSE, RT is returned and RT2
2936 is set equal to RT.
2937
2938 For LD/ST pair instructions PAIR is TRUE, RT and RT2 are returned.
2939
2940 */
68fcca92
JW		 2941
2942static bfd_boolean
3d14faea 2943aarch64_mem_op_p (uint32_t insn, unsigned int *rt, unsigned int *rt2,
68fcca92
JW		 2944 bfd_boolean *pair, bfd_boolean *load)
2945{
2946 uint32_t opcode;
2947 unsigned int r;
2948 uint32_t opc = 0;
2949 uint32_t v = 0;
2950 uint32_t opc_v = 0;
2951
2952 /* Bail out quickly if INSN doesn't fall into the the load-store
2953 encoding space. */
2954 if (!AARCH64_LDST (insn))
2955 return FALSE;
2956
2957 *pair = FALSE;
2958 *load = FALSE;
2959 if (AARCH64_LDST_EX (insn))
2960 {
2961 *rt = AARCH64_RT (insn);
3d14faea 2962 *rt2 = *rt;
68fcca92
JW		 2963 if (AARCH64_BIT (insn, 21) == 1)
2964 {
2965 *pair = TRUE;
3d14faea 2966 *rt2 = AARCH64_RT2 (insn);
68fcca92
JW		 2967 }
2968 *load = AARCH64_LD (insn);
2969 return TRUE;
2970 }
2971 else if (AARCH64_LDST_NAP (insn)
2972 || AARCH64_LDSTP_PI (insn)
2973 || AARCH64_LDSTP_O (insn)
2974 || AARCH64_LDSTP_PRE (insn))
2975 {
2976 *pair = TRUE;
2977 *rt = AARCH64_RT (insn);
3d14faea 2978 *rt2 = AARCH64_RT2 (insn);
68fcca92
JW		 2979 *load = AARCH64_LD (insn);
2980 return TRUE;
2981 }
2982 else if (AARCH64_LDST_PCREL (insn)
2983 || AARCH64_LDST_UI (insn)
2984 || AARCH64_LDST_PIIMM (insn)
2985 || AARCH64_LDST_U (insn)
2986 || AARCH64_LDST_PREIMM (insn)
2987 || AARCH64_LDST_RO (insn)
2988 || AARCH64_LDST_UIMM (insn))
2989 {
2990 *rt = AARCH64_RT (insn);
3d14faea 2991 *rt2 = *rt;
68fcca92
JW		 2992 if (AARCH64_LDST_PCREL (insn))
2993 *load = TRUE;
2994 opc = AARCH64_BITS (insn, 22, 2);
2995 v = AARCH64_BIT (insn, 26);
2996 opc_v = opc | (v << 2);
2997 *load = (opc_v == 1 || opc_v == 2 || opc_v == 3
2998 || opc_v == 5 || opc_v == 7);
2999 return TRUE;
3000 }
3001 else if (AARCH64_LDST_SIMD_M (insn)
3002 || AARCH64_LDST_SIMD_M_PI (insn))
3003 {
3004 *rt = AARCH64_RT (insn);
3005 *load = AARCH64_BIT (insn, 22);
3006 opcode = (insn >> 12) & 0xf;
3007 switch (opcode)
3008 {
3009 case 0:
3010 case 2:
3d14faea 3011 *rt2 = *rt + 3;
68fcca92
JW		 3012 break;
3013
3014 case 4:
3015 case 6:
3d14faea 3016 *rt2 = *rt + 2;
68fcca92
JW		 3017 break;
3018
3019 case 7:
3d14faea 3020 *rt2 = *rt;
68fcca92
JW		 3021 break;
3022
3023 case 8:
3024 case 10:
3d14faea 3025 *rt2 = *rt + 1;
68fcca92
JW		 3026 break;
3027
3028 default:
3029 return FALSE;
3030 }
3031 return TRUE;
3032 }
3033 else if (AARCH64_LDST_SIMD_S (insn)
3034 || AARCH64_LDST_SIMD_S_PI (insn))
3035 {
3036 *rt = AARCH64_RT (insn);
3037 r = (insn >> 21) & 1;
3038 *load = AARCH64_BIT (insn, 22);
3039 opcode = (insn >> 13) & 0x7;
3040 switch (opcode)
3041 {
3042 case 0:
3043 case 2:
3044 case 4:
3d14faea 3045 *rt2 = *rt + r;
68fcca92
JW		 3046 break;
3047
3048 case 1:
3049 case 3:
3050 case 5:
3d14faea 3051 *rt2 = *rt + (r == 0 ? 2 : 3);
68fcca92
JW		 3052 break;
3053
3054 case 6:
3d14faea 3055 *rt2 = *rt + r;
68fcca92
JW		 3056 break;
3057
3058 case 7:
3d14faea 3059 *rt2 = *rt + (r == 0 ? 2 : 3);
68fcca92
JW		 3060 break;
3061
3062 default:
3063 return FALSE;
3064 }
3065 return TRUE;
3066 }
3067
3068 return FALSE;
3069}
3070
3071/* Return TRUE if INSN is multiply-accumulate. */
3072
3073static bfd_boolean
3074aarch64_mlxl_p (uint32_t insn)
3075{
3076 uint32_t op31 = AARCH64_OP31 (insn);
3077
3078 if (AARCH64_MAC (insn)
3079 && (op31 == 0 || op31 == 1 || op31 == 5)
3080 /* Exclude MUL instructions which are encoded as a multiple accumulate
3081 with RA = XZR. */
3082 && AARCH64_RA (insn) != AARCH64_ZR)
3083 return TRUE;
3084
3085 return FALSE;
3086}
3087
3088/* Some early revisions of the Cortex-A53 have an erratum (835769) whereby
3089 it is possible for a 64-bit multiply-accumulate instruction to generate an
3090 incorrect result. The details are quite complex and hard to
3091 determine statically, since branches in the code may exist in some
3092 circumstances, but all cases end with a memory (load, store, or
3093 prefetch) instruction followed immediately by the multiply-accumulate
3094 operation. We employ a linker patching technique, by moving the potentially
3095 affected multiply-accumulate instruction into a patch region and replacing
3096 the original instruction with a branch to the patch. This function checks
3097 if INSN_1 is the memory operation followed by a multiply-accumulate
3098 operation (INSN_2). Return TRUE if an erratum sequence is found, FALSE
3099 if INSN_1 and INSN_2 are safe. */
3100
3101static bfd_boolean
3102aarch64_erratum_sequence (uint32_t insn_1, uint32_t insn_2)
3103{
3104 uint32_t rt;
3d14faea 3105 uint32_t rt2;
68fcca92
JW		 3106 uint32_t rn;
3107 uint32_t rm;
3108 uint32_t ra;
3109 bfd_boolean pair;
3110 bfd_boolean load;
3111
3112 if (aarch64_mlxl_p (insn_2)
3d14faea 3113 && aarch64_mem_op_p (insn_1, &rt, &rt2, &pair, &load))
68fcca92
JW		 3114 {
3115 /* Any SIMD memory op is independent of the subsequent MLA
3116 by definition of the erratum. */
3117 if (AARCH64_BIT (insn_1, 26))
3118 return TRUE;
3119
3120 /* If not SIMD, check for integer memory ops and MLA relationship. */
3121 rn = AARCH64_RN (insn_2);
3122 ra = AARCH64_RA (insn_2);
3123 rm = AARCH64_RM (insn_2);
3124
3125 /* If this is a load and there's a true(RAW) dependency, we are safe
3126 and this is not an erratum sequence. */
3127 if (load &&
3128 (rt == rn || rt == rm || rt == ra
3d14faea 3129 || (pair && (rt2 == rn || rt2 == rm || rt2 == ra))))
68fcca92
JW		 3130 return FALSE;
3131
3132 /* We conservatively put out stubs for all other cases (including
3133 writebacks). */
3134 return TRUE;
3135 }
3136
3137 return FALSE;
3138}
3139
520c7b56
JW		 3140/* Used to order a list of mapping symbols by address. */
3141
3142static int
3143elf_aarch64_compare_mapping (const void *a, const void *b)
3144{
3145 const elf_aarch64_section_map *amap = (const elf_aarch64_section_map *) a;
3146 const elf_aarch64_section_map *bmap = (const elf_aarch64_section_map *) b;
3147
3148 if (amap->vma > bmap->vma)
3149 return 1;
3150 else if (amap->vma < bmap->vma)
3151 return -1;
3152 else if (amap->type > bmap->type)
3153 /* Ensure results do not depend on the host qsort for objects with
3154 multiple mapping symbols at the same address by sorting on type
3155 after vma. */
3156 return 1;
3157 else if (amap->type < bmap->type)
3158 return -1;
3159 else
3160 return 0;
3161}
3162
2144188d 3163
35fee8b7
MS		 3164static char *
3165_bfd_aarch64_erratum_835769_stub_name (unsigned num_fixes)
3166{
3167 char *stub_name = (char *) bfd_malloc
3168 (strlen ("__erratum_835769_veneer_") + 16);
3169 sprintf (stub_name,"__erratum_835769_veneer_%d", num_fixes);
3170 return stub_name;
3171}
3172
4106101c 3173/* Scan for Cortex-A53 erratum 835769 sequence.
2144188d
MS		 3174
3175 Return TRUE else FALSE on abnormal termination. */
3176
68fcca92 3177static bfd_boolean
5421cc6e
MS		 3178_bfd_aarch64_erratum_835769_scan (bfd *input_bfd,
3179 struct bfd_link_info *info,
3180 unsigned int *num_fixes_p)
68fcca92
JW		 3181{
3182 asection *section;
3183 struct elf_aarch64_link_hash_table *htab = elf_aarch64_hash_table (info);
68fcca92 3184 unsigned int num_fixes = *num_fixes_p;
68fcca92
JW		 3185
3186 if (htab == NULL)
2144188d 3187 return TRUE;
68fcca92
JW		 3188
3189 for (section = input_bfd->sections;
3190 section != NULL;
3191 section = section->next)
3192 {
3193 bfd_byte *contents = NULL;
3194 struct _aarch64_elf_section_data *sec_data;
3195 unsigned int span;
3196
3197 if (elf_section_type (section) != SHT_PROGBITS
3198 || (elf_section_flags (section) & SHF_EXECINSTR) == 0
3199 || (section->flags & SEC_EXCLUDE) != 0
3200 || (section->sec_info_type == SEC_INFO_TYPE_JUST_SYMS)
3201 || (section->output_section == bfd_abs_section_ptr))
3202 continue;
3203
3204 if (elf_section_data (section)->this_hdr.contents != NULL)
3205 contents = elf_section_data (section)->this_hdr.contents;
3206 else if (! bfd_malloc_and_get_section (input_bfd, section, &contents))
2144188d 3207 return FALSE;
68fcca92
JW		 3208
3209 sec_data = elf_aarch64_section_data (section);
520c7b56
JW		 3210
3211 qsort (sec_data->map, sec_data->mapcount,
3212 sizeof (elf_aarch64_section_map), elf_aarch64_compare_mapping);
3213
68fcca92
JW		 3214 for (span = 0; span < sec_data->mapcount; span++)
3215 {
3216 unsigned int span_start = sec_data->map[span].vma;
3217 unsigned int span_end = ((span == sec_data->mapcount - 1)
3218 ? sec_data->map[0].vma + section->size
3219 : sec_data->map[span + 1].vma);
3220 unsigned int i;
3221 char span_type = sec_data->map[span].type;
3222
3223 if (span_type == 'd')
3224 continue;
3225
3226 for (i = span_start; i + 4 < span_end; i += 4)
3227 {
3228 uint32_t insn_1 = bfd_getl32 (contents + i);
3229 uint32_t insn_2 = bfd_getl32 (contents + i + 4);
3230
3231 if (aarch64_erratum_sequence (insn_1, insn_2))
3232 {
5421cc6e 3233 struct elf_aarch64_stub_hash_entry *stub_entry;
35fee8b7
MS		 3234 char *stub_name = _bfd_aarch64_erratum_835769_stub_name (num_fixes);
3235 if (! stub_name)
2144188d 3236 return FALSE;
68fcca92 3237
5421cc6e
MS		 3238 stub_entry = _bfd_aarch64_add_stub_entry_in_group (stub_name,
3239 section,
3240 htab);
3241 if (! stub_entry)
3242 return FALSE;
68fcca92 3243
5421cc6e
MS		 3244 stub_entry->stub_type = aarch64_stub_erratum_835769_veneer;
3245 stub_entry->target_section = section;
3246 stub_entry->target_value = i + 4;
3247 stub_entry->veneered_insn = insn_2;
3248 stub_entry->output_name = stub_name;
68fcca92
JW		 3249 num_fixes++;
3250 }
3251 }
3252 }
3253 if (elf_section_data (section)->this_hdr.contents == NULL)
3254 free (contents);
3255 }
3256
357d1523
MS		 3257 *num_fixes_p = num_fixes;
3258
2144188d 3259 return TRUE;
68fcca92
JW		 3260}
3261
13f622ec 3262
4106101c
MS		 3263/* Test if instruction INSN is ADRP. */
3264
3265static bfd_boolean
3266_bfd_aarch64_adrp_p (uint32_t insn)
3267{
3268 return ((insn & 0x9f000000) == 0x90000000);
3269}
3270
3271
3272/* Helper predicate to look for cortex-a53 erratum 843419 sequence 1. */
3273
3274static bfd_boolean
3275_bfd_aarch64_erratum_843419_sequence_p (uint32_t insn_1, uint32_t insn_2,
3276 uint32_t insn_3)
3277{
3278 uint32_t rt;
3279 uint32_t rt2;
3280 bfd_boolean pair;
3281 bfd_boolean load;
3282
3283 return (aarch64_mem_op_p (insn_2, &rt, &rt2, &pair, &load)
3284 && (!pair
3285 || (pair && !load))
3286 && AARCH64_LDST_UIMM (insn_3)
3287 && AARCH64_RN (insn_3) == AARCH64_RD (insn_1));
3288}
3289
3290
3291/* Test for the presence of Cortex-A53 erratum 843419 instruction sequence.
3292
3293 Return TRUE if section CONTENTS at offset I contains one of the
3294 erratum 843419 sequences, otherwise return FALSE. If a sequence is
3295 seen set P_VENEER_I to the offset of the final LOAD/STORE
3296 instruction in the sequence.
3297 */
3298
3299static bfd_boolean
3300_bfd_aarch64_erratum_843419_p (bfd_byte *contents, bfd_vma vma,
3301 bfd_vma i, bfd_vma span_end,
3302 bfd_vma *p_veneer_i)
3303{
3304 uint32_t insn_1 = bfd_getl32 (contents + i);
3305
3306 if (!_bfd_aarch64_adrp_p (insn_1))
3307 return FALSE;
3308
3309 if (span_end < i + 12)
3310 return FALSE;
3311
3312 uint32_t insn_2 = bfd_getl32 (contents + i + 4);
3313 uint32_t insn_3 = bfd_getl32 (contents + i + 8);
3314
3315 if ((vma & 0xfff) != 0xff8 && (vma & 0xfff) != 0xffc)
3316 return FALSE;
3317
3318 if (_bfd_aarch64_erratum_843419_sequence_p (insn_1, insn_2, insn_3))
3319 {
3320 *p_veneer_i = i + 8;
3321 return TRUE;
3322 }
3323
3324 if (span_end < i + 16)
3325 return FALSE;
3326
3327 uint32_t insn_4 = bfd_getl32 (contents + i + 12);
3328
3329 if (_bfd_aarch64_erratum_843419_sequence_p (insn_1, insn_2, insn_4))
3330 {
3331 *p_veneer_i = i + 12;
3332 return TRUE;
3333 }
3334
3335 return FALSE;
3336}
3337
3338
13f622ec
MS		 3339/* Resize all stub sections. */
3340
3341static void
3342_bfd_aarch64_resize_stubs (struct elf_aarch64_link_hash_table *htab)
3343{
3344 asection *section;
3345
3346 /* OK, we've added some stubs. Find out the new size of the
3347 stub sections. */
3348 for (section = htab->stub_bfd->sections;
3349 section != NULL; section = section->next)
3350 {
3351 /* Ignore non-stub sections. */
3352 if (!strstr (section->name, STUB_SUFFIX))
3353 continue;
3354 section->size = 0;
3355 }
3356
3357 bfd_hash_traverse (&htab->stub_hash_table, aarch64_size_one_stub, htab);
13f622ec 3358
61865519
MS		 3359 for (section = htab->stub_bfd->sections;
3360 section != NULL; section = section->next)
3361 {
3362 if (!strstr (section->name, STUB_SUFFIX))
3363 continue;
3364
3365 if (section->size)
3366 section->size += 4;
4106101c
MS		 3367
3368 /* Ensure all stub sections have a size which is a multiple of
3369 4096. This is important in order to ensure that the insertion
3370 of stub sections does not in itself move existing code around
3371 in such a way that new errata sequences are created. */
3372 if (htab->fix_erratum_843419)
3373 if (section->size)
3374 section->size = BFD_ALIGN (section->size, 0x1000);
3375 }
3376}
3377
3378
3379/* Construct an erratum 843419 workaround stub name.
3380 */
3381
3382static char *
3383_bfd_aarch64_erratum_843419_stub_name (asection *input_section,
3384 bfd_vma offset)
3385{
3386 const bfd_size_type len = 8 + 4 + 1 + 8 + 1 + 16 + 1;
3387 char *stub_name = bfd_malloc (len);
3388
3389 if (stub_name != NULL)
3390 snprintf (stub_name, len, "e843419@%04x_%08x_%" BFD_VMA_FMT "x",
3391 input_section->owner->id,
3392 input_section->id,
3393 offset);
3394 return stub_name;
3395}
3396
3397/* Build a stub_entry structure describing an 843419 fixup.
3398
3399 The stub_entry constructed is populated with the bit pattern INSN
3400 of the instruction located at OFFSET within input SECTION.
3401
3402 Returns TRUE on success. */
3403
3404static bfd_boolean
3405_bfd_aarch64_erratum_843419_fixup (uint32_t insn,
3406 bfd_vma adrp_offset,
3407 bfd_vma ldst_offset,
3408 asection *section,
3409 struct bfd_link_info *info)
3410{
3411 struct elf_aarch64_link_hash_table *htab = elf_aarch64_hash_table (info);
3412 char *stub_name;
3413 struct elf_aarch64_stub_hash_entry *stub_entry;
3414
3415 stub_name = _bfd_aarch64_erratum_843419_stub_name (section, ldst_offset);
3416 stub_entry = aarch64_stub_hash_lookup (&htab->stub_hash_table, stub_name,
3417 FALSE, FALSE);
3418 if (stub_entry)
3419 {
3420 free (stub_name);
3421 return TRUE;
3422 }
3423
3424 /* We always place an 843419 workaround veneer in the stub section
3425 attached to the input section in which an erratum sequence has
3426 been found. This ensures that later in the link process (in
3427 elfNN_aarch64_write_section) when we copy the veneered
3428 instruction from the input section into the stub section the
3429 copied instruction will have had any relocations applied to it.
3430 If we placed workaround veneers in any other stub section then we
3431 could not assume that all relocations have been processed on the
3432 corresponding input section at the point we output the stub
3433 section.
3434 */
3435
3436 stub_entry = _bfd_aarch64_add_stub_entry_after (stub_name, section, htab);
3437 if (stub_entry == NULL)
3438 {
3439 free (stub_name);
3440 return FALSE;
3441 }
3442
3443 stub_entry->adrp_offset = adrp_offset;
3444 stub_entry->target_value = ldst_offset;
3445 stub_entry->target_section = section;
3446 stub_entry->stub_type = aarch64_stub_erratum_843419_veneer;
3447 stub_entry->veneered_insn = insn;
3448 stub_entry->output_name = stub_name;
3449
3450 return TRUE;
3451}
3452
3453
3454/* Scan an input section looking for the signature of erratum 843419.
3455
3456 Scans input SECTION in INPUT_BFD looking for erratum 843419
3457 signatures, for each signature found a stub_entry is created
3458 describing the location of the erratum for subsequent fixup.
3459
3460 Return TRUE on successful scan, FALSE on failure to scan.
3461 */
3462
3463static bfd_boolean
3464_bfd_aarch64_erratum_843419_scan (bfd *input_bfd, asection *section,
3465 struct bfd_link_info *info)
3466{
3467 struct elf_aarch64_link_hash_table *htab = elf_aarch64_hash_table (info);
3468
3469 if (htab == NULL)
3470 return TRUE;
3471
3472 if (elf_section_type (section) != SHT_PROGBITS
3473 || (elf_section_flags (section) & SHF_EXECINSTR) == 0
3474 || (section->flags & SEC_EXCLUDE) != 0
3475 || (section->sec_info_type == SEC_INFO_TYPE_JUST_SYMS)
3476 || (section->output_section == bfd_abs_section_ptr))
3477 return TRUE;
3478
3479 do
3480 {
3481 bfd_byte *contents = NULL;
3482 struct _aarch64_elf_section_data *sec_data;
3483 unsigned int span;
3484
3485 if (elf_section_data (section)->this_hdr.contents != NULL)
3486 contents = elf_section_data (section)->this_hdr.contents;
3487 else if (! bfd_malloc_and_get_section (input_bfd, section, &contents))
3488 return FALSE;
3489
3490 sec_data = elf_aarch64_section_data (section);
3491
3492 qsort (sec_data->map, sec_data->mapcount,
3493 sizeof (elf_aarch64_section_map), elf_aarch64_compare_mapping);
3494
3495 for (span = 0; span < sec_data->mapcount; span++)
3496 {
3497 unsigned int span_start = sec_data->map[span].vma;
3498 unsigned int span_end = ((span == sec_data->mapcount - 1)
3499 ? sec_data->map[0].vma + section->size
3500 : sec_data->map[span + 1].vma);
3501 unsigned int i;
3502 char span_type = sec_data->map[span].type;
3503
3504 if (span_type == 'd')
3505 continue;
3506
3507 for (i = span_start; i + 8 < span_end; i += 4)
3508 {
3509 bfd_vma vma = (section->output_section->vma
3510 + section->output_offset
3511 + i);
3512 bfd_vma veneer_i;
3513
3514 if (_bfd_aarch64_erratum_843419_p
3515 (contents, vma, i, span_end, &veneer_i))
3516 {
3517 uint32_t insn = bfd_getl32 (contents + veneer_i);
3518
3519 if (!_bfd_aarch64_erratum_843419_fixup (insn, i, veneer_i,
3520 section, info))
3521 return FALSE;
3522 }
3523 }
3524 }
3525
3526 if (elf_section_data (section)->this_hdr.contents == NULL)
3527 free (contents);
61865519 3528 }
4106101c
MS		 3529 while (0);
3530
3531 return TRUE;
61865519 3532}
13f622ec 3533
4106101c 3534
a06ea964
NC		 3535/* Determine and set the size of the stub section for a final link.
3536
3537 The basic idea here is to examine all the relocations looking for
3538 PC-relative calls to a target that is unreachable with a "bl"
3539 instruction. */
3540
3541bfd_boolean
cec5225b 3542elfNN_aarch64_size_stubs (bfd *output_bfd,
a06ea964
NC		 3543 bfd *stub_bfd,
3544 struct bfd_link_info *info,
3545 bfd_signed_vma group_size,
3546 asection * (*add_stub_section) (const char *,
3547 asection *),
3548 void (*layout_sections_again) (void))
3549{
3550 bfd_size_type stub_group_size;
3551 bfd_boolean stubs_always_before_branch;
5421cc6e 3552 bfd_boolean stub_changed = FALSE;
cec5225b 3553 struct elf_aarch64_link_hash_table *htab = elf_aarch64_hash_table (info);
68fcca92 3554 unsigned int num_erratum_835769_fixes = 0;
a06ea964
NC		 3555
3556 /* Propagate mach to stub bfd, because it may not have been
3557 finalized when we created stub_bfd. */
3558 bfd_set_arch_mach (stub_bfd, bfd_get_arch (output_bfd),
3559 bfd_get_mach (output_bfd));
3560
3561 /* Stash our params away. */
3562 htab->stub_bfd = stub_bfd;
3563 htab->add_stub_section = add_stub_section;
3564 htab->layout_sections_again = layout_sections_again;
3565 stubs_always_before_branch = group_size < 0;
3566 if (group_size < 0)
3567 stub_group_size = -group_size;
3568 else
3569 stub_group_size = group_size;
3570
3571 if (stub_group_size == 1)
3572 {
3573 /* Default values. */
b9eead84 3574 /* AArch64 branch range is +-128MB. The value used is 1MB less. */
a06ea964
NC		 3575 stub_group_size = 127 * 1024 * 1024;
3576 }
3577
3578 group_sections (htab, stub_group_size, stubs_always_before_branch);
3579
4106101c
MS		 3580 (*htab->layout_sections_again) ();
3581
5421cc6e
MS		 3582 if (htab->fix_erratum_835769)
3583 {
3584 bfd *input_bfd;
3585
3586 for (input_bfd = info->input_bfds;
3587 input_bfd != NULL; input_bfd = input_bfd->link.next)
3588 if (!_bfd_aarch64_erratum_835769_scan (input_bfd, info,
3589 &num_erratum_835769_fixes))
3590 return FALSE;
3591
4106101c
MS		 3592 _bfd_aarch64_resize_stubs (htab);
3593 (*htab->layout_sections_again) ();
3594 }
3595
3596 if (htab->fix_erratum_843419)
3597 {
3598 bfd *input_bfd;
3599
3600 for (input_bfd = info->input_bfds;
3601 input_bfd != NULL;
3602 input_bfd = input_bfd->link.next)
3603 {
3604 asection *section;
3605
3606 for (section = input_bfd->sections;
3607 section != NULL;
3608 section = section->next)
3609 if (!_bfd_aarch64_erratum_843419_scan (input_bfd, section, info))
3610 return FALSE;
3611 }
3612
3613 _bfd_aarch64_resize_stubs (htab);
3614 (*htab->layout_sections_again) ();
5421cc6e
MS		 3615 }
3616
a06ea964
NC		 3617 while (1)
3618 {
3619 bfd *input_bfd;
a06ea964 3620
9b9971aa
MS		 3621 for (input_bfd = info->input_bfds;
3622 input_bfd != NULL; input_bfd = input_bfd->link.next)
a06ea964
NC		 3623 {
3624 Elf_Internal_Shdr *symtab_hdr;
3625 asection *section;
3626 Elf_Internal_Sym *local_syms = NULL;
3627
3628 /* We'll need the symbol table in a second. */
3629 symtab_hdr = &elf_tdata (input_bfd)->symtab_hdr;
3630 if (symtab_hdr->sh_info == 0)
3631 continue;
3632
3633 /* Walk over each section attached to the input bfd. */
3634 for (section = input_bfd->sections;
3635 section != NULL; section = section->next)
3636 {
3637 Elf_Internal_Rela *internal_relocs, *irelaend, *irela;
3638
3639 /* If there aren't any relocs, then there's nothing more
3640 to do. */
3641 if ((section->flags & SEC_RELOC) == 0
3642 || section->reloc_count == 0
3643 || (section->flags & SEC_CODE) == 0)
3644 continue;
3645
3646 /* If this section is a link-once section that will be
3647 discarded, then don't create any stubs. */
3648 if (section->output_section == NULL
3649 || section->output_section->owner != output_bfd)
3650 continue;
3651
3652 /* Get the relocs. */
3653 internal_relocs
3654 = _bfd_elf_link_read_relocs (input_bfd, section, NULL,
3655 NULL, info->keep_memory);
3656 if (internal_relocs == NULL)
3657 goto error_ret_free_local;
3658
3659 /* Now examine each relocation. */
3660 irela = internal_relocs;
3661 irelaend = irela + section->reloc_count;
3662 for (; irela < irelaend; irela++)
3663 {
3664 unsigned int r_type, r_indx;
cec5225b
YZ		 3665 enum elf_aarch64_stub_type stub_type;
3666 struct elf_aarch64_stub_hash_entry *stub_entry;
a06ea964
NC		 3667 asection *sym_sec;
3668 bfd_vma sym_value;
3669 bfd_vma destination;
cec5225b 3670 struct elf_aarch64_link_hash_entry *hash;
a06ea964
NC		 3671 const char *sym_name;
3672 char *stub_name;
3673 const asection *id_sec;
3674 unsigned char st_type;
3675 bfd_size_type len;
3676
cec5225b
YZ		 3677 r_type = ELFNN_R_TYPE (irela->r_info);
3678 r_indx = ELFNN_R_SYM (irela->r_info);
a06ea964
NC		 3679
3680 if (r_type >= (unsigned int) R_AARCH64_end)
3681 {
3682 bfd_set_error (bfd_error_bad_value);
3683 error_ret_free_internal:
3684 if (elf_section_data (section)->relocs == NULL)
3685 free (internal_relocs);
3686 goto error_ret_free_local;
3687 }
3688
3689 /* Only look for stubs on unconditional branch and
3690 branch and link instructions. */
a6bb11b2
YZ		 3691 if (r_type != (unsigned int) AARCH64_R (CALL26)
3692 && r_type != (unsigned int) AARCH64_R (JUMP26))
a06ea964
NC		 3693 continue;
3694
3695 /* Now determine the call target, its name, value,
3696 section. */
3697 sym_sec = NULL;
3698 sym_value = 0;
3699 destination = 0;
3700 hash = NULL;
3701 sym_name = NULL;
3702 if (r_indx < symtab_hdr->sh_info)
3703 {
3704 /* It's a local symbol. */
3705 Elf_Internal_Sym *sym;
3706 Elf_Internal_Shdr *hdr;
3707
3708 if (local_syms == NULL)
3709 {
3710 local_syms
3711 = (Elf_Internal_Sym *) symtab_hdr->contents;
3712 if (local_syms == NULL)
3713 local_syms
3714 = bfd_elf_get_elf_syms (input_bfd, symtab_hdr,
3715 symtab_hdr->sh_info, 0,
3716 NULL, NULL, NULL);
3717 if (local_syms == NULL)
3718 goto error_ret_free_internal;
3719 }
3720
3721 sym = local_syms + r_indx;
3722 hdr = elf_elfsections (input_bfd)[sym->st_shndx];
3723 sym_sec = hdr->bfd_section;
3724 if (!sym_sec)
3725 /* This is an undefined symbol. It can never
3726 be resolved. */
3727 continue;
3728
3729 if (ELF_ST_TYPE (sym->st_info) != STT_SECTION)
3730 sym_value = sym->st_value;
3731 destination = (sym_value + irela->r_addend
3732 + sym_sec->output_offset
3733 + sym_sec->output_section->vma);
3734 st_type = ELF_ST_TYPE (sym->st_info);
3735 sym_name
3736 = bfd_elf_string_from_elf_section (input_bfd,
3737 symtab_hdr->sh_link,
3738 sym->st_name);
3739 }
3740 else
3741 {
3742 int e_indx;
3743
3744 e_indx = r_indx - symtab_hdr->sh_info;
cec5225b 3745 hash = ((struct elf_aarch64_link_hash_entry *)
a06ea964
NC		 3746 elf_sym_hashes (input_bfd)[e_indx]);
3747
3748 while (hash->root.root.type == bfd_link_hash_indirect
3749 || hash->root.root.type == bfd_link_hash_warning)
cec5225b 3750 hash = ((struct elf_aarch64_link_hash_entry *)
a06ea964
NC		 3751 hash->root.root.u.i.link);
3752
3753 if (hash->root.root.type == bfd_link_hash_defined
3754 || hash->root.root.type == bfd_link_hash_defweak)
3755 {
cec5225b
YZ		 3756 struct elf_aarch64_link_hash_table *globals =
3757 elf_aarch64_hash_table (info);
a06ea964
NC		 3758 sym_sec = hash->root.root.u.def.section;
3759 sym_value = hash->root.root.u.def.value;
3760 /* For a destination in a shared library,
3761 use the PLT stub as target address to
3762 decide whether a branch stub is
3763 needed. */
3764 if (globals->root.splt != NULL && hash != NULL
3765 && hash->root.plt.offset != (bfd_vma) - 1)
3766 {
3767 sym_sec = globals->root.splt;
3768 sym_value = hash->root.plt.offset;
3769 if (sym_sec->output_section != NULL)
3770 destination = (sym_value
3771 + sym_sec->output_offset
3772 +
3773 sym_sec->output_section->vma);
3774 }
3775 else if (sym_sec->output_section != NULL)
3776 destination = (sym_value + irela->r_addend
3777 + sym_sec->output_offset
3778 + sym_sec->output_section->vma);
3779 }
3780 else if (hash->root.root.type == bfd_link_hash_undefined
3781 || (hash->root.root.type
3782 == bfd_link_hash_undefweak))
3783 {
3784 /* For a shared library, use the PLT stub as
3785 target address to decide whether a long
3786 branch stub is needed.
3787 For absolute code, they cannot be handled. */
cec5225b
YZ		 3788 struct elf_aarch64_link_hash_table *globals =
3789 elf_aarch64_hash_table (info);
a06ea964
NC		 3790
3791 if (globals->root.splt != NULL && hash != NULL
3792 && hash->root.plt.offset != (bfd_vma) - 1)
3793 {
3794 sym_sec = globals->root.splt;
3795 sym_value = hash->root.plt.offset;
3796 if (sym_sec->output_section != NULL)
3797 destination = (sym_value
3798 + sym_sec->output_offset
3799 +
3800 sym_sec->output_section->vma);
3801 }
3802 else
3803 continue;
3804 }
3805 else
3806 {
3807 bfd_set_error (bfd_error_bad_value);
3808 goto error_ret_free_internal;
3809 }
3810 st_type = ELF_ST_TYPE (hash->root.type);
3811 sym_name = hash->root.root.root.string;
3812 }
3813
3814 /* Determine what (if any) linker stub is needed. */
3815 stub_type = aarch64_type_of_stub
3816 (info, section, irela, st_type, hash, destination);
3817 if (stub_type == aarch64_stub_none)
3818 continue;
3819
3820 /* Support for grouping stub sections. */
3821 id_sec = htab->stub_group[section->id].link_sec;
3822
3823 /* Get the name of this stub. */
cec5225b 3824 stub_name = elfNN_aarch64_stub_name (id_sec, sym_sec, hash,
a06ea964
NC		 3825 irela);
3826 if (!stub_name)
3827 goto error_ret_free_internal;
3828
3829 stub_entry =
3830 aarch64_stub_hash_lookup (&htab->stub_hash_table,
3831 stub_name, FALSE, FALSE);
3832 if (stub_entry != NULL)
3833 {
3834 /* The proper stub has already been created. */
3835 free (stub_name);
3836 continue;
3837 }
3838
ef857521
MS		 3839 stub_entry = _bfd_aarch64_add_stub_entry_in_group
3840 (stub_name, section, htab);
a06ea964
NC		 3841 if (stub_entry == NULL)
3842 {
3843 free (stub_name);
3844 goto error_ret_free_internal;
3845 }
3846
3847 stub_entry->target_value = sym_value;
3848 stub_entry->target_section = sym_sec;
3849 stub_entry->stub_type = stub_type;
3850 stub_entry->h = hash;
3851 stub_entry->st_type = st_type;
3852
3853 if (sym_name == NULL)
3854 sym_name = "unnamed";
3855 len = sizeof (STUB_ENTRY_NAME) + strlen (sym_name);
3856 stub_entry->output_name = bfd_alloc (htab->stub_bfd, len);
3857 if (stub_entry->output_name == NULL)
3858 {
3859 free (stub_name);
3860 goto error_ret_free_internal;
3861 }
3862
3863 snprintf (stub_entry->output_name, len, STUB_ENTRY_NAME,
3864 sym_name);
3865
3866 stub_changed = TRUE;
3867 }
3868
3869 /* We're done with the internal relocs, free them. */
3870 if (elf_section_data (section)->relocs == NULL)
3871 free (internal_relocs);
3872 }
3873 }
3874
3875 if (!stub_changed)
3876 break;
3877
13f622ec 3878 _bfd_aarch64_resize_stubs (htab);
a06ea964
NC		 3879
3880 /* Ask the linker to do its stuff. */
3881 (*htab->layout_sections_again) ();
3882 stub_changed = FALSE;
3883 }
3884
3885 return TRUE;
3886
3887error_ret_free_local:
3888 return FALSE;
3889}
3890
3891/* Build all the stubs associated with the current output file. The
3892 stubs are kept in a hash table attached to the main linker hash
3893 table. We also set up the .plt entries for statically linked PIC
3894 functions here. This function is called via aarch64_elf_finish in the
3895 linker. */
3896
3897bfd_boolean
cec5225b 3898elfNN_aarch64_build_stubs (struct bfd_link_info *info)
a06ea964
NC		 3899{
3900 asection *stub_sec;
3901 struct bfd_hash_table *table;
cec5225b 3902 struct elf_aarch64_link_hash_table *htab;
a06ea964 3903
cec5225b 3904 htab = elf_aarch64_hash_table (info);
a06ea964
NC		 3905
3906 for (stub_sec = htab->stub_bfd->sections;
3907 stub_sec != NULL; stub_sec = stub_sec->next)
3908 {
3909 bfd_size_type size;
3910
3911 /* Ignore non-stub sections. */
3912 if (!strstr (stub_sec->name, STUB_SUFFIX))
3913 continue;
3914
3915 /* Allocate memory to hold the linker stubs. */
3916 size = stub_sec->size;
3917 stub_sec->contents = bfd_zalloc (htab->stub_bfd, size);
3918 if (stub_sec->contents == NULL && size != 0)
3919 return FALSE;
3920 stub_sec->size = 0;
61865519
MS		 3921
3922 bfd_putl32 (0x14000000 | (size >> 2), stub_sec->contents);
3923 stub_sec->size += 4;
a06ea964
NC		 3924 }
3925
3926 /* Build the stubs as directed by the stub hash table. */
3927 table = &htab->stub_hash_table;
3928 bfd_hash_traverse (table, aarch64_build_one_stub, info);
3929
3930 return TRUE;
3931}
3932
3933
3934/* Add an entry to the code/data map for section SEC. */
3935
3936static void
cec5225b 3937elfNN_aarch64_section_map_add (asection *sec, char type, bfd_vma vma)
a06ea964
NC		 3938{
3939 struct _aarch64_elf_section_data *sec_data =
cec5225b 3940 elf_aarch64_section_data (sec);
a06ea964
NC		 3941 unsigned int newidx;
3942
3943 if (sec_data->map == NULL)
3944 {
cec5225b 3945 sec_data->map = bfd_malloc (sizeof (elf_aarch64_section_map));
a06ea964
NC		 3946 sec_data->mapcount = 0;
3947 sec_data->mapsize = 1;
3948 }
3949
3950 newidx = sec_data->mapcount++;
3951
3952 if (sec_data->mapcount > sec_data->mapsize)
3953 {
3954 sec_data->mapsize *= 2;
3955 sec_data->map = bfd_realloc_or_free
cec5225b 3956 (sec_data->map, sec_data->mapsize * sizeof (elf_aarch64_section_map));
a06ea964
NC		 3957 }
3958
3959 if (sec_data->map)
3960 {
3961 sec_data->map[newidx].vma = vma;
3962 sec_data->map[newidx].type = type;
3963 }
3964}
3965
3966
3967/* Initialise maps of insn/data for input BFDs. */
3968void
cec5225b 3969bfd_elfNN_aarch64_init_maps (bfd *abfd)
a06ea964
NC		 3970{
3971 Elf_Internal_Sym *isymbuf;
3972 Elf_Internal_Shdr *hdr;
3973 unsigned int i, localsyms;
3974
3975 /* Make sure that we are dealing with an AArch64 elf binary. */
3976 if (!is_aarch64_elf (abfd))
3977 return;
3978
3979 if ((abfd->flags & DYNAMIC) != 0)
68fcca92 3980 return;
a06ea964
NC		 3981
3982 hdr = &elf_symtab_hdr (abfd);
3983 localsyms = hdr->sh_info;
3984
3985 /* Obtain a buffer full of symbols for this BFD. The hdr->sh_info field
3986 should contain the number of local symbols, which should come before any
3987 global symbols. Mapping symbols are always local. */
3988 isymbuf = bfd_elf_get_elf_syms (abfd, hdr, localsyms, 0, NULL, NULL, NULL);
3989
3990 /* No internal symbols read? Skip this BFD. */
3991 if (isymbuf == NULL)
3992 return;
3993
3994 for (i = 0; i < localsyms; i++)
3995 {
3996 Elf_Internal_Sym *isym = &isymbuf[i];
3997 asection *sec = bfd_section_from_elf_index (abfd, isym->st_shndx);
3998 const char *name;
3999
4000 if (sec != NULL && ELF_ST_BIND (isym->st_info) == STB_LOCAL)
4001 {
4002 name = bfd_elf_string_from_elf_section (abfd,
4003 hdr->sh_link,
4004 isym->st_name);
4005
4006 if (bfd_is_aarch64_special_symbol_name
4007 (name, BFD_AARCH64_SPECIAL_SYM_TYPE_MAP))
cec5225b 4008 elfNN_aarch64_section_map_add (sec, name[1], isym->st_value);
a06ea964
NC		 4009 }
4010 }
4011}
4012
4013/* Set option values needed during linking. */
4014void
cec5225b 4015bfd_elfNN_aarch64_set_options (struct bfd *output_bfd,
a06ea964
NC		 4016 struct bfd_link_info *link_info,
4017 int no_enum_warn,
68fcca92 4018 int no_wchar_warn, int pic_veneer,
4106101c
MS		 4019 int fix_erratum_835769,
4020 int fix_erratum_843419)
a06ea964 4021{
cec5225b 4022 struct elf_aarch64_link_hash_table *globals;
a06ea964 4023
cec5225b 4024 globals = elf_aarch64_hash_table (link_info);
a06ea964 4025 globals->pic_veneer = pic_veneer;
68fcca92 4026 globals->fix_erratum_835769 = fix_erratum_835769;
4106101c
MS		 4027 globals->fix_erratum_843419 = fix_erratum_843419;
4028 globals->fix_erratum_843419_adr = TRUE;
a06ea964
NC		 4029
4030 BFD_ASSERT (is_aarch64_elf (output_bfd));
4031 elf_aarch64_tdata (output_bfd)->no_enum_size_warning = no_enum_warn;
4032 elf_aarch64_tdata (output_bfd)->no_wchar_size_warning = no_wchar_warn;
4033}
4034
a06ea964
NC		 4035static bfd_vma
4036aarch64_calculate_got_entry_vma (struct elf_link_hash_entry *h,
cec5225b 4037 struct elf_aarch64_link_hash_table
a06ea964
NC		 4038 *globals, struct bfd_link_info *info,
4039 bfd_vma value, bfd *output_bfd,
4040 bfd_boolean *unresolved_reloc_p)
4041{
4042 bfd_vma off = (bfd_vma) - 1;
4043 asection *basegot = globals->root.sgot;
4044 bfd_boolean dyn = globals->root.dynamic_sections_created;
4045
4046 if (h != NULL)
4047 {
a6bb11b2 4048 BFD_ASSERT (basegot != NULL);
a06ea964
NC		 4049 off = h->got.offset;
4050 BFD_ASSERT (off != (bfd_vma) - 1);
4051 if (!WILL_CALL_FINISH_DYNAMIC_SYMBOL (dyn, info->shared, h)
4052 || (info->shared
4053 && SYMBOL_REFERENCES_LOCAL (info, h))
4054 || (ELF_ST_VISIBILITY (h->other)
4055 && h->root.type == bfd_link_hash_undefweak))
4056 {
4057 /* This is actually a static link, or it is a -Bsymbolic link
4058 and the symbol is defined locally. We must initialize this
4059 entry in the global offset table. Since the offset must
a6bb11b2
YZ		 4060 always be a multiple of 8 (4 in the case of ILP32), we use
4061 the least significant bit to record whether we have
4062 initialized it already.
a06ea964
NC		 4063 When doing a dynamic link, we create a .rel(a).got relocation
4064 entry to initialize the value. This is done in the
4065 finish_dynamic_symbol routine. */
4066 if ((off & 1) != 0)
4067 off &= ~1;
4068 else
4069 {
cec5225b 4070 bfd_put_NN (output_bfd, value, basegot->contents + off);
a06ea964
NC		 4071 h->got.offset |= 1;
4072 }
4073 }
4074 else
4075 *unresolved_reloc_p = FALSE;
4076
4077 off = off + basegot->output_section->vma + basegot->output_offset;
4078 }
4079
4080 return off;
4081}
4082
4083/* Change R_TYPE to a more efficient access model where possible,
4084 return the new reloc type. */
4085
a6bb11b2
YZ		 4086static bfd_reloc_code_real_type
4087aarch64_tls_transition_without_check (bfd_reloc_code_real_type r_type,
a06ea964
NC		 4088 struct elf_link_hash_entry *h)
4089{
4090 bfd_boolean is_local = h == NULL;
a6bb11b2 4091
a06ea964
NC		 4092 switch (r_type)
4093 {
a6bb11b2 4094 case BFD_RELOC_AARCH64_TLSDESC_ADR_PAGE21:
ce336788 4095 case BFD_RELOC_AARCH64_TLSGD_ADR_PAGE21:
a6bb11b2
YZ		 4096 return (is_local
4097 ? BFD_RELOC_AARCH64_TLSLE_MOVW_TPREL_G1
4098 : BFD_RELOC_AARCH64_TLSIE_ADR_GOTTPREL_PAGE21);
4099
389b8029
MS		 4100 case BFD_RELOC_AARCH64_TLSDESC_ADR_PREL21:
4101 return (is_local
4102 ? BFD_RELOC_AARCH64_TLSLE_MOVW_TPREL_G0_NC
4103 : r_type);
4104
1ada945d
MS		 4105 case BFD_RELOC_AARCH64_TLSDESC_LD_PREL19:
4106 return (is_local
4107 ? BFD_RELOC_AARCH64_TLSLE_MOVW_TPREL_G1
4108 : BFD_RELOC_AARCH64_TLSIE_LD_GOTTPREL_PREL19);
4109
a6bb11b2 4110 case BFD_RELOC_AARCH64_TLSDESC_LDNN_LO12_NC:
ce336788 4111 case BFD_RELOC_AARCH64_TLSGD_ADD_LO12_NC:
a6bb11b2
YZ		 4112 return (is_local
4113 ? BFD_RELOC_AARCH64_TLSLE_MOVW_TPREL_G0_NC
4114 : BFD_RELOC_AARCH64_TLSIE_LDNN_GOTTPREL_LO12_NC);
4115
4116 case BFD_RELOC_AARCH64_TLSIE_ADR_GOTTPREL_PAGE21:
4117 return is_local ? BFD_RELOC_AARCH64_TLSLE_MOVW_TPREL_G1 : r_type;
4118
4119 case BFD_RELOC_AARCH64_TLSIE_LDNN_GOTTPREL_LO12_NC:
4120 return is_local ? BFD_RELOC_AARCH64_TLSLE_MOVW_TPREL_G0_NC : r_type;
4121
043bf05a
MS		 4122 case BFD_RELOC_AARCH64_TLSIE_LD_GOTTPREL_PREL19:
4123 return r_type;
4124
3c12b054
MS		 4125 case BFD_RELOC_AARCH64_TLSGD_ADR_PREL21:
4126 return (is_local
4127 ? BFD_RELOC_AARCH64_TLSLE_ADD_TPREL_HI12
4128 : BFD_RELOC_AARCH64_TLSIE_LD_GOTTPREL_PREL19);
4129
a6bb11b2
YZ		 4130 case BFD_RELOC_AARCH64_TLSDESC_ADD_LO12_NC:
4131 case BFD_RELOC_AARCH64_TLSDESC_CALL:
a06ea964 4132 /* Instructions with these relocations will become NOPs. */
a6bb11b2
YZ		 4133 return BFD_RELOC_AARCH64_NONE;
4134
4135 default:
4136 break;
a06ea964
NC		 4137 }
4138
4139 return r_type;
4140}
4141
4142static unsigned int
a6bb11b2 4143aarch64_reloc_got_type (bfd_reloc_code_real_type r_type)
a06ea964
NC		 4144{
4145 switch (r_type)
4146 {
a6bb11b2
YZ		 4147 case BFD_RELOC_AARCH64_ADR_GOT_PAGE:
4148 case BFD_RELOC_AARCH64_GOT_LD_PREL19:
7018c030 4149 case BFD_RELOC_AARCH64_LD32_GOTPAGE_LO14:
ce336788 4150 case BFD_RELOC_AARCH64_LD32_GOT_LO12_NC:
99ad26cb 4151 case BFD_RELOC_AARCH64_LD64_GOTPAGE_LO15:
ce336788 4152 case BFD_RELOC_AARCH64_LD64_GOT_LO12_NC:
a06ea964
NC		 4153 return GOT_NORMAL;
4154
ce336788 4155 case BFD_RELOC_AARCH64_TLSGD_ADD_LO12_NC:
a6bb11b2 4156 case BFD_RELOC_AARCH64_TLSGD_ADR_PAGE21:
3c12b054 4157 case BFD_RELOC_AARCH64_TLSGD_ADR_PREL21:
73f925cc 4158 case BFD_RELOC_AARCH64_TLSLD_ADD_LO12_NC:
f69e4920 4159 case BFD_RELOC_AARCH64_TLSLD_ADR_PAGE21:
77a69ff8 4160 case BFD_RELOC_AARCH64_TLSLD_ADR_PREL21:
a06ea964
NC		 4161 return GOT_TLS_GD;
4162
a6bb11b2
YZ		 4163 case BFD_RELOC_AARCH64_TLSDESC_ADD_LO12_NC:
4164 case BFD_RELOC_AARCH64_TLSDESC_ADR_PAGE21:
389b8029 4165 case BFD_RELOC_AARCH64_TLSDESC_ADR_PREL21:
a6bb11b2 4166 case BFD_RELOC_AARCH64_TLSDESC_CALL:
a6bb11b2 4167 case BFD_RELOC_AARCH64_TLSDESC_LD32_LO12_NC:
ce336788 4168 case BFD_RELOC_AARCH64_TLSDESC_LD64_LO12_NC:
1ada945d 4169 case BFD_RELOC_AARCH64_TLSDESC_LD_PREL19:
a06ea964
NC		 4170 return GOT_TLSDESC_GD;
4171
a6bb11b2 4172 case BFD_RELOC_AARCH64_TLSIE_ADR_GOTTPREL_PAGE21:
a6bb11b2 4173 case BFD_RELOC_AARCH64_TLSIE_LD32_GOTTPREL_LO12_NC:
ce336788 4174 case BFD_RELOC_AARCH64_TLSIE_LD64_GOTTPREL_LO12_NC:
043bf05a 4175 case BFD_RELOC_AARCH64_TLSIE_LD_GOTTPREL_PREL19:
a06ea964
NC		 4176 return GOT_TLS_IE;
4177
40fbed84 4178 case BFD_RELOC_AARCH64_TLSLD_ADD_DTPREL_LO12:
a6bb11b2
YZ		 4179 case BFD_RELOC_AARCH64_TLSLE_ADD_TPREL_HI12:
4180 case BFD_RELOC_AARCH64_TLSLE_ADD_TPREL_LO12:
4181 case BFD_RELOC_AARCH64_TLSLE_ADD_TPREL_LO12_NC:
4182 case BFD_RELOC_AARCH64_TLSLE_MOVW_TPREL_G0:
4183 case BFD_RELOC_AARCH64_TLSLE_MOVW_TPREL_G0_NC:
4184 case BFD_RELOC_AARCH64_TLSLE_MOVW_TPREL_G1:
4185 case BFD_RELOC_AARCH64_TLSLE_MOVW_TPREL_G1_NC:
4186 case BFD_RELOC_AARCH64_TLSLE_MOVW_TPREL_G2:
a06ea964 4187 return GOT_UNKNOWN;
a6bb11b2
YZ		 4188
4189 default:
4190 break;
a06ea964
NC		 4191 }
4192 return GOT_UNKNOWN;
4193}
4194
4195static bfd_boolean
4196aarch64_can_relax_tls (bfd *input_bfd,
4197 struct bfd_link_info *info,
a6bb11b2 4198 bfd_reloc_code_real_type r_type,
a06ea964
NC		 4199 struct elf_link_hash_entry *h,
4200 unsigned long r_symndx)
4201{
4202 unsigned int symbol_got_type;
4203 unsigned int reloc_got_type;
4204
4205 if (! IS_AARCH64_TLS_RELOC (r_type))
4206 return FALSE;
4207
cec5225b 4208 symbol_got_type = elfNN_aarch64_symbol_got_type (h, input_bfd, r_symndx);
a06ea964
NC		 4209 reloc_got_type = aarch64_reloc_got_type (r_type);
4210
4211 if (symbol_got_type == GOT_TLS_IE && GOT_TLS_GD_ANY_P (reloc_got_type))
4212 return TRUE;
4213
4214 if (info->shared)
4215 return FALSE;
4216
4217 if (h && h->root.type == bfd_link_hash_undefweak)
4218 return FALSE;
4219
4220 return TRUE;
4221}
4222
a6bb11b2
YZ		 4223/* Given the relocation code R_TYPE, return the relaxed bfd reloc
4224 enumerator. */
4225
4226static bfd_reloc_code_real_type
a06ea964
NC		 4227aarch64_tls_transition (bfd *input_bfd,
4228 struct bfd_link_info *info,
4229 unsigned int r_type,
4230 struct elf_link_hash_entry *h,
4231 unsigned long r_symndx)
4232{
a6bb11b2
YZ		 4233 bfd_reloc_code_real_type bfd_r_type
4234 = elfNN_aarch64_bfd_reloc_from_type (r_type);
a06ea964 4235
a6bb11b2
YZ		 4236 if (! aarch64_can_relax_tls (input_bfd, info, bfd_r_type, h, r_symndx))
4237 return bfd_r_type;
4238
4239 return aarch64_tls_transition_without_check (bfd_r_type, h);
a06ea964
NC		 4240}
4241
4242/* Return the base VMA address which should be subtracted from real addresses
a6bb11b2 4243 when resolving R_AARCH64_TLS_DTPREL relocation. */
a06ea964
NC		 4244
4245static bfd_vma
4246dtpoff_base (struct bfd_link_info *info)
4247{
4248 /* If tls_sec is NULL, we should have signalled an error already. */
4249 BFD_ASSERT (elf_hash_table (info)->tls_sec != NULL);
4250 return elf_hash_table (info)->tls_sec->vma;
4251}
4252
a06ea964
NC		 4253/* Return the base VMA address which should be subtracted from real addresses
4254 when resolving R_AARCH64_TLS_GOTTPREL64 relocations. */
4255
4256static bfd_vma
4257tpoff_base (struct bfd_link_info *info)
4258{
4259 struct elf_link_hash_table *htab = elf_hash_table (info);
4260
4261 /* If tls_sec is NULL, we should have signalled an error already. */
ac21917f 4262 BFD_ASSERT (htab->tls_sec != NULL);
a06ea964
NC		 4263
4264 bfd_vma base = align_power ((bfd_vma) TCB_SIZE,
4265 htab->tls_sec->alignment_power);
4266 return htab->tls_sec->vma - base;
4267}
4268
4269static bfd_vma *
4270symbol_got_offset_ref (bfd *input_bfd, struct elf_link_hash_entry *h,
4271 unsigned long r_symndx)
4272{
4273 /* Calculate the address of the GOT entry for symbol
4274 referred to in h. */
4275 if (h != NULL)
4276 return &h->got.offset;
4277 else
4278 {
4279 /* local symbol */
4280 struct elf_aarch64_local_symbol *l;
4281
cec5225b 4282 l = elf_aarch64_locals (input_bfd);
a06ea964
NC		 4283 return &l[r_symndx].got_offset;
4284 }
4285}
4286
4287static void
4288symbol_got_offset_mark (bfd *input_bfd, struct elf_link_hash_entry *h,
4289 unsigned long r_symndx)
4290{
4291 bfd_vma *p;
4292 p = symbol_got_offset_ref (input_bfd, h, r_symndx);
4293 *p |= 1;
4294}
4295
4296static int
4297symbol_got_offset_mark_p (bfd *input_bfd, struct elf_link_hash_entry *h,
4298 unsigned long r_symndx)
4299{
4300 bfd_vma value;
4301 value = * symbol_got_offset_ref (input_bfd, h, r_symndx);
4302 return value & 1;
4303}
4304
4305static bfd_vma
4306symbol_got_offset (bfd *input_bfd, struct elf_link_hash_entry *h,
4307 unsigned long r_symndx)
4308{
4309 bfd_vma value;
4310 value = * symbol_got_offset_ref (input_bfd, h, r_symndx);
4311 value &= ~1;
4312 return value;
4313}
4314
4315static bfd_vma *
4316symbol_tlsdesc_got_offset_ref (bfd *input_bfd, struct elf_link_hash_entry *h,
4317 unsigned long r_symndx)
4318{
4319 /* Calculate the address of the GOT entry for symbol
4320 referred to in h. */
4321 if (h != NULL)
4322 {
cec5225b
YZ		 4323 struct elf_aarch64_link_hash_entry *eh;
4324 eh = (struct elf_aarch64_link_hash_entry *) h;
a06ea964
NC		 4325 return &eh->tlsdesc_got_jump_table_offset;
4326 }
4327 else
4328 {
4329 /* local symbol */
4330 struct elf_aarch64_local_symbol *l;
4331
cec5225b 4332 l = elf_aarch64_locals (input_bfd);
a06ea964
NC		 4333 return &l[r_symndx].tlsdesc_got_jump_table_offset;
4334 }
4335}
4336
4337static void
4338symbol_tlsdesc_got_offset_mark (bfd *input_bfd, struct elf_link_hash_entry *h,
4339 unsigned long r_symndx)
4340{
4341 bfd_vma *p;
4342 p = symbol_tlsdesc_got_offset_ref (input_bfd, h, r_symndx);
4343 *p |= 1;
4344}
4345
4346static int
4347symbol_tlsdesc_got_offset_mark_p (bfd *input_bfd,
4348 struct elf_link_hash_entry *h,
4349 unsigned long r_symndx)
4350{
4351 bfd_vma value;
4352 value = * symbol_tlsdesc_got_offset_ref (input_bfd, h, r_symndx);
4353 return value & 1;
4354}
4355
4356static bfd_vma
4357symbol_tlsdesc_got_offset (bfd *input_bfd, struct elf_link_hash_entry *h,
4358 unsigned long r_symndx)
4359{
4360 bfd_vma value;
4361 value = * symbol_tlsdesc_got_offset_ref (input_bfd, h, r_symndx);
4362 value &= ~1;
4363 return value;
4364}
4365
68fcca92
JW		 4366/* Data for make_branch_to_erratum_835769_stub(). */
4367
4368struct erratum_835769_branch_to_stub_data
4369{
4106101c 4370 struct bfd_link_info *info;
68fcca92
JW		 4371 asection *output_section;
4372 bfd_byte *contents;
4373};
4374
4375/* Helper to insert branches to erratum 835769 stubs in the right
4376 places for a particular section. */
4377
4378static bfd_boolean
4379make_branch_to_erratum_835769_stub (struct bfd_hash_entry *gen_entry,
4380 void *in_arg)
4381{
4382 struct elf_aarch64_stub_hash_entry *stub_entry;
4383 struct erratum_835769_branch_to_stub_data *data;
4384 bfd_byte *contents;
4385 unsigned long branch_insn = 0;
4386 bfd_vma veneered_insn_loc, veneer_entry_loc;
4387 bfd_signed_vma branch_offset;
4388 unsigned int target;
4389 bfd *abfd;
4390
4391 stub_entry = (struct elf_aarch64_stub_hash_entry *) gen_entry;
4392 data = (struct erratum_835769_branch_to_stub_data *) in_arg;
4393
4394 if (stub_entry->target_section != data->output_section
4395 || stub_entry->stub_type != aarch64_stub_erratum_835769_veneer)
4396 return TRUE;
4397
4398 contents = data->contents;
4399 veneered_insn_loc = stub_entry->target_section->output_section->vma
4400 + stub_entry->target_section->output_offset
4401 + stub_entry->target_value;
4402 veneer_entry_loc = stub_entry->stub_sec->output_section->vma
4403 + stub_entry->stub_sec->output_offset
4404 + stub_entry->stub_offset;
4405 branch_offset = veneer_entry_loc - veneered_insn_loc;
4406
4407 abfd = stub_entry->target_section->owner;
4408 if (!aarch64_valid_branch_p (veneer_entry_loc, veneered_insn_loc))
4409 (*_bfd_error_handler)
4410 (_("%B: error: Erratum 835769 stub out "
4411 "of range (input file too large)"), abfd);
4412
4413 target = stub_entry->target_value;
4414 branch_insn = 0x14000000;
4415 branch_offset >>= 2;
4416 branch_offset &= 0x3ffffff;
4417 branch_insn |= branch_offset;
4418 bfd_putl32 (branch_insn, &contents[target]);
4419
4420 return TRUE;
4421}
4422
4106101c
MS		 4423
4424static bfd_boolean
4425_bfd_aarch64_erratum_843419_branch_to_stub (struct bfd_hash_entry *gen_entry,
4426 void *in_arg)
4427{
4428 struct elf_aarch64_stub_hash_entry *stub_entry
4429 = (struct elf_aarch64_stub_hash_entry *) gen_entry;
4430 struct erratum_835769_branch_to_stub_data *data
4431 = (struct erratum_835769_branch_to_stub_data *) in_arg;
4432 struct bfd_link_info *info;
4433 struct elf_aarch64_link_hash_table *htab;
4434 bfd_byte *contents;
4435 asection *section;
4436 bfd *abfd;
4437 bfd_vma place;
4438 uint32_t insn;
4439
4440 info = data->info;
4441 contents = data->contents;
4442 section = data->output_section;
4443
4444 htab = elf_aarch64_hash_table (info);
4445
4446 if (stub_entry->target_section != section
4447 || stub_entry->stub_type != aarch64_stub_erratum_843419_veneer)
4448 return TRUE;
4449
4450 insn = bfd_getl32 (contents + stub_entry->target_value);
4451 bfd_putl32 (insn,
4452 stub_entry->stub_sec->contents + stub_entry->stub_offset);
4453
4454 place = (section->output_section->vma + section->output_offset
4455 + stub_entry->adrp_offset);
4456 insn = bfd_getl32 (contents + stub_entry->adrp_offset);
4457
4458 if ((insn & AARCH64_ADRP_OP_MASK) != AARCH64_ADRP_OP)
4459 abort ();
4460
4461 bfd_signed_vma imm =
4462 (_bfd_aarch64_sign_extend
4463 ((bfd_vma) _bfd_aarch64_decode_adrp_imm (insn) << 12, 33)
4464 - (place & 0xfff));
4465
4466 if (htab->fix_erratum_843419_adr
4467 && (imm >= AARCH64_MIN_ADRP_IMM && imm <= AARCH64_MAX_ADRP_IMM))
4468 {
4469 insn = (_bfd_aarch64_reencode_adr_imm (AARCH64_ADR_OP, imm)
4470 | AARCH64_RT (insn));
4471 bfd_putl32 (insn, contents + stub_entry->adrp_offset);
4472 }
4473 else
4474 {
4475 bfd_vma veneered_insn_loc;
4476 bfd_vma veneer_entry_loc;
4477 bfd_signed_vma branch_offset;
4478 uint32_t branch_insn;
4479
4480 veneered_insn_loc = stub_entry->target_section->output_section->vma
4481 + stub_entry->target_section->output_offset
4482 + stub_entry->target_value;
4483 veneer_entry_loc = stub_entry->stub_sec->output_section->vma
4484 + stub_entry->stub_sec->output_offset
4485 + stub_entry->stub_offset;
4486 branch_offset = veneer_entry_loc - veneered_insn_loc;
4487
4488 abfd = stub_entry->target_section->owner;
4489 if (!aarch64_valid_branch_p (veneer_entry_loc, veneered_insn_loc))
4490 (*_bfd_error_handler)
4491 (_("%B: error: Erratum 843419 stub out "
4492 "of range (input file too large)"), abfd);
4493
4494 branch_insn = 0x14000000;
4495 branch_offset >>= 2;
4496 branch_offset &= 0x3ffffff;
4497 branch_insn |= branch_offset;
4498 bfd_putl32 (branch_insn, contents + stub_entry->target_value);
4499 }
4500 return TRUE;
4501}
4502
4503
68fcca92
JW		 4504static bfd_boolean
4505elfNN_aarch64_write_section (bfd *output_bfd ATTRIBUTE_UNUSED,
4506 struct bfd_link_info *link_info,
4507 asection *sec,
4508 bfd_byte *contents)
4509
4510{
4511 struct elf_aarch64_link_hash_table *globals =
f872121a 4512 elf_aarch64_hash_table (link_info);
68fcca92
JW		 4513
4514 if (globals == NULL)
4515 return FALSE;
4516
4517 /* Fix code to point to erratum 835769 stubs. */
4518 if (globals->fix_erratum_835769)
4519 {
4520 struct erratum_835769_branch_to_stub_data data;
4521
4106101c 4522 data.info = link_info;
68fcca92
JW		 4523 data.output_section = sec;
4524 data.contents = contents;
4525 bfd_hash_traverse (&globals->stub_hash_table,
4526 make_branch_to_erratum_835769_stub, &data);
4527 }
4528
4106101c
MS		 4529 if (globals->fix_erratum_843419)
4530 {
4531 struct erratum_835769_branch_to_stub_data data;
4532
4533 data.info = link_info;
4534 data.output_section = sec;
4535 data.contents = contents;
4536 bfd_hash_traverse (&globals->stub_hash_table,
4537 _bfd_aarch64_erratum_843419_branch_to_stub, &data);
4538 }
4539
68fcca92
JW		 4540 return FALSE;
4541}
4542
a06ea964
NC		 4543/* Perform a relocation as part of a final link. */
4544static bfd_reloc_status_type
cec5225b 4545elfNN_aarch64_final_link_relocate (reloc_howto_type *howto,
a06ea964
NC		 4546 bfd *input_bfd,
4547 bfd *output_bfd,
4548 asection *input_section,
4549 bfd_byte *contents,
4550 Elf_Internal_Rela *rel,
4551 bfd_vma value,
4552 struct bfd_link_info *info,
4553 asection *sym_sec,
4554 struct elf_link_hash_entry *h,
4555 bfd_boolean *unresolved_reloc_p,
4556 bfd_boolean save_addend,
1419bbe5
WN		 4557 bfd_vma *saved_addend,
4558 Elf_Internal_Sym *sym)
a06ea964 4559{
1419bbe5 4560 Elf_Internal_Shdr *symtab_hdr;
a06ea964 4561 unsigned int r_type = howto->type;
a6bb11b2
YZ		 4562 bfd_reloc_code_real_type bfd_r_type
4563 = elfNN_aarch64_bfd_reloc_from_howto (howto);
4564 bfd_reloc_code_real_type new_bfd_r_type;
a06ea964
NC		 4565 unsigned long r_symndx;
4566 bfd_byte *hit_data = contents + rel->r_offset;
b53b1bed 4567 bfd_vma place, off;
a06ea964 4568 bfd_signed_vma signed_addend;
cec5225b 4569 struct elf_aarch64_link_hash_table *globals;
a06ea964 4570 bfd_boolean weak_undef_p;
b53b1bed 4571 asection *base_got;
a06ea964 4572
cec5225b 4573 globals = elf_aarch64_hash_table (info);
a06ea964 4574
1419bbe5
WN		 4575 symtab_hdr = &elf_symtab_hdr (input_bfd);
4576
a06ea964
NC		 4577 BFD_ASSERT (is_aarch64_elf (input_bfd));
4578
cec5225b 4579 r_symndx = ELFNN_R_SYM (rel->r_info);
a06ea964
NC		 4580
4581 /* It is possible to have linker relaxations on some TLS access
4582 models. Update our information here. */
a6bb11b2
YZ		 4583 new_bfd_r_type = aarch64_tls_transition (input_bfd, info, r_type, h, r_symndx);
4584 if (new_bfd_r_type != bfd_r_type)
4585 {
4586 bfd_r_type = new_bfd_r_type;
4587 howto = elfNN_aarch64_howto_from_bfd_reloc (bfd_r_type);
4588 BFD_ASSERT (howto != NULL);
4589 r_type = howto->type;
4590 }
a06ea964
NC		 4591
4592 place = input_section->output_section->vma
4593 + input_section->output_offset + rel->r_offset;
4594
4595 /* Get addend, accumulating the addend for consecutive relocs
4596 which refer to the same offset. */
4597 signed_addend = saved_addend ? *saved_addend : 0;
4598 signed_addend += rel->r_addend;
4599
4600 weak_undef_p = (h ? h->root.type == bfd_link_hash_undefweak
4601 : bfd_is_und_section (sym_sec));
a6bb11b2 4602
1419bbe5
WN		 4603 /* Since STT_GNU_IFUNC symbol must go through PLT, we handle
4604 it here if it is defined in a non-shared object. */
4605 if (h != NULL
4606 && h->type == STT_GNU_IFUNC
4607 && h->def_regular)
4608 {
4609 asection *plt;
4610 const char *name;
99ad26cb 4611 bfd_vma addend = 0;
1419bbe5
WN		 4612
4613 if ((input_section->flags & SEC_ALLOC) == 0
4614 || h->plt.offset == (bfd_vma) -1)
4615 abort ();
4616
4617 /* STT_GNU_IFUNC symbol must go through PLT. */
4618 plt = globals->root.splt ? globals->root.splt : globals->root.iplt;
4619 value = (plt->output_section->vma + plt->output_offset + h->plt.offset);
4620
4621 switch (bfd_r_type)
4622 {
4623 default:
4624 if (h->root.root.string)
4625 name = h->root.root.string;
4626 else
4627 name = bfd_elf_sym_name (input_bfd, symtab_hdr, sym,
4628 NULL);
4629 (*_bfd_error_handler)
4630 (_("%B: relocation %s against STT_GNU_IFUNC "
4631 "symbol `%s' isn't handled by %s"), input_bfd,
4632 howto->name, name, __FUNCTION__);
4633 bfd_set_error (bfd_error_bad_value);
4634 return FALSE;
4635
4636 case BFD_RELOC_AARCH64_NN:
4637 if (rel->r_addend != 0)
4638 {
4639 if (h->root.root.string)
4640 name = h->root.root.string;
4641 else
4642 name = bfd_elf_sym_name (input_bfd, symtab_hdr,
4643 sym, NULL);
4644 (*_bfd_error_handler)
4645 (_("%B: relocation %s against STT_GNU_IFUNC "
4646 "symbol `%s' has non-zero addend: %d"),
4647 input_bfd, howto->name, name, rel->r_addend);
4648 bfd_set_error (bfd_error_bad_value);
4649 return FALSE;
4650 }
4651
4652 /* Generate dynamic relocation only when there is a
4653 non-GOT reference in a shared object. */
4654 if (info->shared && h->non_got_ref)
4655 {
4656 Elf_Internal_Rela outrel;
4657 asection *sreloc;
4658
4659 /* Need a dynamic relocation to get the real function
4660 address. */
4661 outrel.r_offset = _bfd_elf_section_offset (output_bfd,
4662 info,
4663 input_section,
4664 rel->r_offset);
4665 if (outrel.r_offset == (bfd_vma) -1
4666 || outrel.r_offset == (bfd_vma) -2)
4667 abort ();
4668
4669 outrel.r_offset += (input_section->output_section->vma
4670 + input_section->output_offset);
4671
4672 if (h->dynindx == -1
4673 || h->forced_local
4674 || info->executable)
4675 {
4676 /* This symbol is resolved locally. */
4677 outrel.r_info = ELFNN_R_INFO (0, AARCH64_R (IRELATIVE));
4678 outrel.r_addend = (h->root.u.def.value
4679 + h->root.u.def.section->output_section->vma
4680 + h->root.u.def.section->output_offset);
4681 }
4682 else
4683 {
4684 outrel.r_info = ELFNN_R_INFO (h->dynindx, r_type);
4685 outrel.r_addend = 0;
4686 }
4687
4688 sreloc = globals->root.irelifunc;
4689 elf_append_rela (output_bfd, sreloc, &outrel);
4690
4691 /* If this reloc is against an external symbol, we
4692 do not want to fiddle with the addend. Otherwise,
4693 we need to include the symbol value so that it
4694 becomes an addend for the dynamic reloc. For an
4695 internal symbol, we have updated addend. */
4696 return bfd_reloc_ok;
4697 }
4698 /* FALLTHROUGH */
1419bbe5 4699 case BFD_RELOC_AARCH64_CALL26:
ce336788 4700 case BFD_RELOC_AARCH64_JUMP26:
1419bbe5
WN		 4701 value = _bfd_aarch64_elf_resolve_relocation (bfd_r_type, place, value,
4702 signed_addend,
4703 weak_undef_p);
4704 return _bfd_aarch64_elf_put_addend (input_bfd, hit_data, bfd_r_type,
4705 howto, value);
1419bbe5
WN		 4706 case BFD_RELOC_AARCH64_ADR_GOT_PAGE:
4707 case BFD_RELOC_AARCH64_GOT_LD_PREL19:
7018c030 4708 case BFD_RELOC_AARCH64_LD32_GOTPAGE_LO14:
ce336788 4709 case BFD_RELOC_AARCH64_LD32_GOT_LO12_NC:
99ad26cb 4710 case BFD_RELOC_AARCH64_LD64_GOTPAGE_LO15:
ce336788 4711 case BFD_RELOC_AARCH64_LD64_GOT_LO12_NC:
1419bbe5
WN		 4712 base_got = globals->root.sgot;
4713 off = h->got.offset;
4714
4715 if (base_got == NULL)
4716 abort ();
4717
4718 if (off == (bfd_vma) -1)
4719 {
4720 bfd_vma plt_index;
4721
4722 /* We can't use h->got.offset here to save state, or
4723 even just remember the offset, as finish_dynamic_symbol
4724 would use that as offset into .got. */
4725
4726 if (globals->root.splt != NULL)
4727 {
b1ee0cc4
WN		 4728 plt_index = ((h->plt.offset - globals->plt_header_size) /
4729 globals->plt_entry_size);
1419bbe5
WN		 4730 off = (plt_index + 3) * GOT_ENTRY_SIZE;
4731 base_got = globals->root.sgotplt;
4732 }
4733 else
4734 {
4735 plt_index = h->plt.offset / globals->plt_entry_size;
4736 off = plt_index * GOT_ENTRY_SIZE;
4737 base_got = globals->root.igotplt;
4738 }
4739
4740 if (h->dynindx == -1
4741 || h->forced_local
4742 || info->symbolic)
4743 {
4744 /* This references the local definition. We must
4745 initialize this entry in the global offset table.
4746 Since the offset must always be a multiple of 8,
4747 we use the least significant bit to record
4748 whether we have initialized it already.
4749
4750 When doing a dynamic link, we create a .rela.got
4751 relocation entry to initialize the value. This
4752 is done in the finish_dynamic_symbol routine. */
4753 if ((off & 1) != 0)
4754 off &= ~1;
4755 else
4756 {
4757 bfd_put_NN (output_bfd, value,
4758 base_got->contents + off);
4759 /* Note that this is harmless as -1 | 1 still is -1. */
4760 h->got.offset |= 1;
4761 }
4762 }
4763 value = (base_got->output_section->vma
4764 + base_got->output_offset + off);
4765 }
4766 else
4767 value = aarch64_calculate_got_entry_vma (h, globals, info,
4768 value, output_bfd,
4769 unresolved_reloc_p);
7018c030
JW		 4770 if (bfd_r_type == BFD_RELOC_AARCH64_LD64_GOTPAGE_LO15
4771 || bfd_r_type == BFD_RELOC_AARCH64_LD32_GOTPAGE_LO14)
99ad26cb
JW		 4772 addend = (globals->root.sgot->output_section->vma
4773 + globals->root.sgot->output_offset);
1419bbe5 4774 value = _bfd_aarch64_elf_resolve_relocation (bfd_r_type, place, value,
99ad26cb 4775 addend, weak_undef_p);
1419bbe5 4776 return _bfd_aarch64_elf_put_addend (input_bfd, hit_data, bfd_r_type, howto, value);
1419bbe5 4777 case BFD_RELOC_AARCH64_ADD_LO12:
ce336788 4778 case BFD_RELOC_AARCH64_ADR_HI21_PCREL:
1419bbe5
WN		 4779 break;
4780 }
4781 }
4782
a6bb11b2 4783 switch (bfd_r_type)
a06ea964 4784 {
a6bb11b2
YZ		 4785 case BFD_RELOC_AARCH64_NONE:
4786 case BFD_RELOC_AARCH64_TLSDESC_CALL:
a06ea964
NC		 4787 *unresolved_reloc_p = FALSE;
4788 return bfd_reloc_ok;
4789
a6bb11b2 4790 case BFD_RELOC_AARCH64_NN:
a06ea964
NC		 4791
4792 /* When generating a shared object or relocatable executable, these
4793 relocations are copied into the output file to be resolved at
4794 run time. */
4795 if (((info->shared == TRUE) || globals->root.is_relocatable_executable)
4796 && (input_section->flags & SEC_ALLOC)
4797 && (h == NULL
4798 || ELF_ST_VISIBILITY (h->other) == STV_DEFAULT
4799 || h->root.type != bfd_link_hash_undefweak))
4800 {
4801 Elf_Internal_Rela outrel;
4802 bfd_byte *loc;
4803 bfd_boolean skip, relocate;
4804 asection *sreloc;
4805
4806 *unresolved_reloc_p = FALSE;
4807
a06ea964
NC		 4808 skip = FALSE;
4809 relocate = FALSE;
4810
4811 outrel.r_addend = signed_addend;
4812 outrel.r_offset =
4813 _bfd_elf_section_offset (output_bfd, info, input_section,
4814 rel->r_offset);
4815 if (outrel.r_offset == (bfd_vma) - 1)
4816 skip = TRUE;
4817 else if (outrel.r_offset == (bfd_vma) - 2)
4818 {
4819 skip = TRUE;
4820 relocate = TRUE;
4821 }
4822
4823 outrel.r_offset += (input_section->output_section->vma
4824 + input_section->output_offset);
4825
4826 if (skip)
4827 memset (&outrel, 0, sizeof outrel);
4828 else if (h != NULL
4829 && h->dynindx != -1
0941db69 4830 && (!info->shared || !SYMBOLIC_BIND (info, h) || !h->def_regular))
cec5225b 4831 outrel.r_info = ELFNN_R_INFO (h->dynindx, r_type);
a06ea964
NC		 4832 else
4833 {
4834 int symbol;
4835
4836 /* On SVR4-ish systems, the dynamic loader cannot
4837 relocate the text and data segments independently,
4838 so the symbol does not matter. */
4839 symbol = 0;
a6bb11b2 4840 outrel.r_info = ELFNN_R_INFO (symbol, AARCH64_R (RELATIVE));
a06ea964
NC		 4841 outrel.r_addend += value;
4842 }
4843
1419bbe5
WN		 4844 sreloc = elf_section_data (input_section)->sreloc;
4845 if (sreloc == NULL || sreloc->contents == NULL)
4846 return bfd_reloc_notsupported;
4847
4848 loc = sreloc->contents + sreloc->reloc_count++ * RELOC_SIZE (globals);
cec5225b 4849 bfd_elfNN_swap_reloca_out (output_bfd, &outrel, loc);
a06ea964 4850
1419bbe5 4851 if (sreloc->reloc_count * RELOC_SIZE (globals) > sreloc->size)
a06ea964
NC		 4852 {
4853 /* Sanity to check that we have previously allocated
4854 sufficient space in the relocation section for the
4855 number of relocations we actually want to emit. */
4856 abort ();
4857 }
4858
4859 /* If this reloc is against an external symbol, we do not want to
4860 fiddle with the addend. Otherwise, we need to include the symbol
4861 value so that it becomes an addend for the dynamic reloc. */
4862 if (!relocate)
4863 return bfd_reloc_ok;
4864
4865 return _bfd_final_link_relocate (howto, input_bfd, input_section,
4866 contents, rel->r_offset, value,
4867 signed_addend);
4868 }
4869 else
4870 value += signed_addend;
4871 break;
4872
a6bb11b2 4873 case BFD_RELOC_AARCH64_CALL26:
ce336788 4874 case BFD_RELOC_AARCH64_JUMP26:
a06ea964
NC		 4875 {
4876 asection *splt = globals->root.splt;
4877 bfd_boolean via_plt_p =
4878 splt != NULL && h != NULL && h->plt.offset != (bfd_vma) - 1;
4879
4880 /* A call to an undefined weak symbol is converted to a jump to
4881 the next instruction unless a PLT entry will be created.
4882 The jump to the next instruction is optimized as a NOP.
4883 Do the same for local undefined symbols. */
4884 if (weak_undef_p && ! via_plt_p)
4885 {
4886 bfd_putl32 (INSN_NOP, hit_data);
4887 return bfd_reloc_ok;
4888 }
4889
4890 /* If the call goes through a PLT entry, make sure to
4891 check distance to the right destination address. */
4892 if (via_plt_p)
4893 {
4894 value = (splt->output_section->vma
4895 + splt->output_offset + h->plt.offset);
4896 *unresolved_reloc_p = FALSE;
4897 }
4898
4899 /* If the target symbol is global and marked as a function the
4900 relocation applies a function call or a tail call. In this
4901 situation we can veneer out of range branches. The veneers
4902 use IP0 and IP1 hence cannot be used arbitrary out of range
4903 branches that occur within the body of a function. */
4904 if (h && h->type == STT_FUNC)
4905 {
4906 /* Check if a stub has to be inserted because the destination
4907 is too far away. */
4908 if (! aarch64_valid_branch_p (value, place))
4909 {
4910 /* The target is out of reach, so redirect the branch to
4911 the local stub for this function. */
cec5225b
YZ		 4912 struct elf_aarch64_stub_hash_entry *stub_entry;
4913 stub_entry = elfNN_aarch64_get_stub_entry (input_section,
a06ea964
NC		 4914 sym_sec, h,
4915 rel, globals);
4916 if (stub_entry != NULL)
4917 value = (stub_entry->stub_offset
4918 + stub_entry->stub_sec->output_offset
4919 + stub_entry->stub_sec->output_section->vma);
4920 }
4921 }
4922 }
caed7120
YZ		 4923 value = _bfd_aarch64_elf_resolve_relocation (bfd_r_type, place, value,
4924 signed_addend, weak_undef_p);
a06ea964
NC		 4925 break;
4926
dcbd20eb
JW		 4927 case BFD_RELOC_AARCH64_16_PCREL:
4928 case BFD_RELOC_AARCH64_32_PCREL:
4929 case BFD_RELOC_AARCH64_64_PCREL:
ce336788
JW		 4930 case BFD_RELOC_AARCH64_ADR_HI21_NC_PCREL:
4931 case BFD_RELOC_AARCH64_ADR_HI21_PCREL:
4932 case BFD_RELOC_AARCH64_ADR_LO21_PCREL:
4933 case BFD_RELOC_AARCH64_LD_LO19_PCREL:
dcbd20eb
JW		 4934 if (info->shared
4935 && (input_section->flags & SEC_ALLOC) != 0
4936 && (input_section->flags & SEC_READONLY) != 0
4937 && h != NULL
4938 && !h->def_regular)
4939 {
4940 int howto_index = bfd_r_type - BFD_RELOC_AARCH64_RELOC_START;
4941
4942 (*_bfd_error_handler)
4943 (_("%B: relocation %s against external symbol `%s' can not be used"
4944 " when making a shared object; recompile with -fPIC"),
4945 input_bfd, elfNN_aarch64_howto_table[howto_index].name,
4946 h->root.root.string);
4947 bfd_set_error (bfd_error_bad_value);
4948 return FALSE;
4949 }
4950
a6bb11b2
YZ		 4951 case BFD_RELOC_AARCH64_16:
4952#if ARCH_SIZE == 64
4953 case BFD_RELOC_AARCH64_32:
4954#endif
4955 case BFD_RELOC_AARCH64_ADD_LO12:
a6bb11b2 4956 case BFD_RELOC_AARCH64_BRANCH19:
ce336788 4957 case BFD_RELOC_AARCH64_LDST128_LO12:
a6bb11b2
YZ		 4958 case BFD_RELOC_AARCH64_LDST16_LO12:
4959 case BFD_RELOC_AARCH64_LDST32_LO12:
4960 case BFD_RELOC_AARCH64_LDST64_LO12:
ce336788 4961 case BFD_RELOC_AARCH64_LDST8_LO12:
a6bb11b2
YZ		 4962 case BFD_RELOC_AARCH64_MOVW_G0:
4963 case BFD_RELOC_AARCH64_MOVW_G0_NC:
ce336788 4964 case BFD_RELOC_AARCH64_MOVW_G0_S:
a6bb11b2
YZ		 4965 case BFD_RELOC_AARCH64_MOVW_G1:
4966 case BFD_RELOC_AARCH64_MOVW_G1_NC:
ce336788 4967 case BFD_RELOC_AARCH64_MOVW_G1_S:
a6bb11b2
YZ		 4968 case BFD_RELOC_AARCH64_MOVW_G2:
4969 case BFD_RELOC_AARCH64_MOVW_G2_NC:
ce336788 4970 case BFD_RELOC_AARCH64_MOVW_G2_S:
a6bb11b2 4971 case BFD_RELOC_AARCH64_MOVW_G3:
a6bb11b2 4972 case BFD_RELOC_AARCH64_TSTBR14:
caed7120
YZ		 4973 value = _bfd_aarch64_elf_resolve_relocation (bfd_r_type, place, value,
4974 signed_addend, weak_undef_p);
a06ea964
NC		 4975 break;
4976
a6bb11b2
YZ		 4977 case BFD_RELOC_AARCH64_ADR_GOT_PAGE:
4978 case BFD_RELOC_AARCH64_GOT_LD_PREL19:
7018c030 4979 case BFD_RELOC_AARCH64_LD32_GOTPAGE_LO14:
ce336788 4980 case BFD_RELOC_AARCH64_LD32_GOT_LO12_NC:
99ad26cb 4981 case BFD_RELOC_AARCH64_LD64_GOTPAGE_LO15:
ce336788 4982 case BFD_RELOC_AARCH64_LD64_GOT_LO12_NC:
a06ea964
NC		 4983 if (globals->root.sgot == NULL)
4984 BFD_ASSERT (h != NULL);
4985
4986 if (h != NULL)
4987 {
99ad26cb 4988 bfd_vma addend = 0;
a06ea964
NC		 4989 value = aarch64_calculate_got_entry_vma (h, globals, info, value,
4990 output_bfd,
4991 unresolved_reloc_p);
7018c030
JW		 4992 if (bfd_r_type == BFD_RELOC_AARCH64_LD64_GOTPAGE_LO15
4993 || bfd_r_type == BFD_RELOC_AARCH64_LD32_GOTPAGE_LO14)
99ad26cb
JW		 4994 addend = (globals->root.sgot->output_section->vma
4995 + globals->root.sgot->output_offset);
caed7120 4996 value = _bfd_aarch64_elf_resolve_relocation (bfd_r_type, place, value,
99ad26cb 4997 addend, weak_undef_p);
a06ea964 4998 }
b53b1bed
JW		 4999 else
5000 {
99ad26cb 5001 bfd_vma addend = 0;
b53b1bed
JW		 5002 struct elf_aarch64_local_symbol *locals
5003 = elf_aarch64_locals (input_bfd);
5004
5005 if (locals == NULL)
5006 {
5007 int howto_index = bfd_r_type - BFD_RELOC_AARCH64_RELOC_START;
5008 (*_bfd_error_handler)
5009 (_("%B: Local symbol descriptor table be NULL when applying "
5010 "relocation %s against local symbol"),
5011 input_bfd, elfNN_aarch64_howto_table[howto_index].name);
5012 abort ();
5013 }
5014
5015 off = symbol_got_offset (input_bfd, h, r_symndx);
5016 base_got = globals->root.sgot;
5017 bfd_vma got_entry_addr = (base_got->output_section->vma
5018 + base_got->output_offset + off);
5019
5020 if (!symbol_got_offset_mark_p (input_bfd, h, r_symndx))
5021 {
5022 bfd_put_64 (output_bfd, value, base_got->contents + off);
5023
5024 if (info->shared)
5025 {
5026 asection *s;
5027 Elf_Internal_Rela outrel;
5028
5029 /* For local symbol, we have done absolute relocation in static
5030 linking stageh. While for share library, we need to update
5031 the content of GOT entry according to the share objects
5032 loading base address. So we need to generate a
5033 R_AARCH64_RELATIVE reloc for dynamic linker. */
5034 s = globals->root.srelgot;
5035 if (s == NULL)
5036 abort ();
5037
5038 outrel.r_offset = got_entry_addr;
5039 outrel.r_info = ELFNN_R_INFO (0, AARCH64_R (RELATIVE));
5040 outrel.r_addend = value;
5041 elf_append_rela (output_bfd, s, &outrel);
5042 }
5043
5044 symbol_got_offset_mark (input_bfd, h, r_symndx);
5045 }
5046
5047 /* Update the relocation value to GOT entry addr as we have transformed
5048 the direct data access into indirect data access through GOT. */
5049 value = got_entry_addr;
99ad26cb 5050
7018c030
JW		 5051 if (bfd_r_type == BFD_RELOC_AARCH64_LD64_GOTPAGE_LO15
5052 || bfd_r_type == BFD_RELOC_AARCH64_LD32_GOTPAGE_LO14)
99ad26cb
JW		 5053 addend = base_got->output_section->vma + base_got->output_offset;
5054
5055 value = _bfd_aarch64_elf_resolve_relocation (bfd_r_type, place, value,
5056 addend, weak_undef_p);
b53b1bed
JW		 5057 }
5058
a06ea964
NC		 5059 break;
5060
ce336788 5061 case BFD_RELOC_AARCH64_TLSGD_ADD_LO12_NC:
a6bb11b2 5062 case BFD_RELOC_AARCH64_TLSGD_ADR_PAGE21:
3c12b054 5063 case BFD_RELOC_AARCH64_TLSGD_ADR_PREL21:
a6bb11b2 5064 case BFD_RELOC_AARCH64_TLSIE_ADR_GOTTPREL_PAGE21:
a6bb11b2 5065 case BFD_RELOC_AARCH64_TLSIE_LD32_GOTTPREL_LO12_NC:
ce336788 5066 case BFD_RELOC_AARCH64_TLSIE_LD64_GOTTPREL_LO12_NC:
043bf05a 5067 case BFD_RELOC_AARCH64_TLSIE_LD_GOTTPREL_PREL19:
73f925cc 5068 case BFD_RELOC_AARCH64_TLSLD_ADD_LO12_NC:
f69e4920 5069 case BFD_RELOC_AARCH64_TLSLD_ADR_PAGE21:
77a69ff8 5070 case BFD_RELOC_AARCH64_TLSLD_ADR_PREL21:
a06ea964
NC		 5071 if (globals->root.sgot == NULL)
5072 return bfd_reloc_notsupported;
5073
5074 value = (symbol_got_offset (input_bfd, h, r_symndx)
5075 + globals->root.sgot->output_section->vma
f44a1f8e 5076 + globals->root.sgot->output_offset);
a06ea964 5077
caed7120
YZ		 5078 value = _bfd_aarch64_elf_resolve_relocation (bfd_r_type, place, value,
5079 0, weak_undef_p);
a06ea964
NC		 5080 *unresolved_reloc_p = FALSE;
5081 break;
5082
40fbed84
JW		 5083 case BFD_RELOC_AARCH64_TLSLD_ADD_DTPREL_LO12:
5084 value = _bfd_aarch64_elf_resolve_relocation (bfd_r_type, place, value,
5085 signed_addend - dtpoff_base (info),
5086 weak_undef_p);
5087 break;
5088
a6bb11b2
YZ		 5089 case BFD_RELOC_AARCH64_TLSLE_ADD_TPREL_HI12:
5090 case BFD_RELOC_AARCH64_TLSLE_ADD_TPREL_LO12:
5091 case BFD_RELOC_AARCH64_TLSLE_ADD_TPREL_LO12_NC:
5092 case BFD_RELOC_AARCH64_TLSLE_MOVW_TPREL_G0:
5093 case BFD_RELOC_AARCH64_TLSLE_MOVW_TPREL_G0_NC:
5094 case BFD_RELOC_AARCH64_TLSLE_MOVW_TPREL_G1:
5095 case BFD_RELOC_AARCH64_TLSLE_MOVW_TPREL_G1_NC:
5096 case BFD_RELOC_AARCH64_TLSLE_MOVW_TPREL_G2:
caed7120
YZ		 5097 value = _bfd_aarch64_elf_resolve_relocation (bfd_r_type, place, value,
5098 signed_addend - tpoff_base (info),
5099 weak_undef_p);
a06ea964
NC		 5100 *unresolved_reloc_p = FALSE;
5101 break;
5102
7bcccb57
MS		 5103 case BFD_RELOC_AARCH64_TLSDESC_ADD:
5104 case BFD_RELOC_AARCH64_TLSDESC_ADD_LO12_NC:
a6bb11b2 5105 case BFD_RELOC_AARCH64_TLSDESC_ADR_PAGE21:
389b8029 5106 case BFD_RELOC_AARCH64_TLSDESC_ADR_PREL21:
a6bb11b2 5107 case BFD_RELOC_AARCH64_TLSDESC_LD32_LO12_NC:
7bcccb57 5108 case BFD_RELOC_AARCH64_TLSDESC_LD64_LO12_NC:
a6bb11b2 5109 case BFD_RELOC_AARCH64_TLSDESC_LDR:
1ada945d 5110 case BFD_RELOC_AARCH64_TLSDESC_LD_PREL19:
a06ea964
NC		 5111 if (globals->root.sgot == NULL)
5112 return bfd_reloc_notsupported;
a06ea964
NC		 5113 value = (symbol_tlsdesc_got_offset (input_bfd, h, r_symndx)
5114 + globals->root.sgotplt->output_section->vma
f44a1f8e 5115 + globals->root.sgotplt->output_offset
a06ea964
NC		 5116 + globals->sgotplt_jump_table_size);
5117
caed7120
YZ		 5118 value = _bfd_aarch64_elf_resolve_relocation (bfd_r_type, place, value,
5119 0, weak_undef_p);
a06ea964
NC		 5120 *unresolved_reloc_p = FALSE;
5121 break;
5122
5123 default:
5124 return bfd_reloc_notsupported;
5125 }
5126
5127 if (saved_addend)
5128 *saved_addend = value;
5129
5130 /* Only apply the final relocation in a sequence. */
5131 if (save_addend)
5132 return bfd_reloc_continue;
5133
caed7120
YZ		 5134 return _bfd_aarch64_elf_put_addend (input_bfd, hit_data, bfd_r_type,
5135 howto, value);
a06ea964
NC		 5136}
5137
5138/* Handle TLS relaxations. Relaxing is possible for symbols that use
5139 R_AARCH64_TLSDESC_ADR_{PAGE, LD64_LO12_NC, ADD_LO12_NC} during a static
5140 link.
5141
5142 Return bfd_reloc_ok if we're done, bfd_reloc_continue if the caller
5143 is to then call final_link_relocate. Return other values in the
5144 case of error. */
5145
5146static bfd_reloc_status_type
cec5225b 5147elfNN_aarch64_tls_relax (struct elf_aarch64_link_hash_table *globals,
a06ea964
NC		 5148 bfd *input_bfd, bfd_byte *contents,
5149 Elf_Internal_Rela *rel, struct elf_link_hash_entry *h)
5150{
5151 bfd_boolean is_local = h == NULL;
cec5225b 5152 unsigned int r_type = ELFNN_R_TYPE (rel->r_info);
a06ea964
NC		 5153 unsigned long insn;
5154
5155 BFD_ASSERT (globals && input_bfd && contents && rel);
5156
a6bb11b2 5157 switch (elfNN_aarch64_bfd_reloc_from_type (r_type))
a06ea964 5158 {
a6bb11b2 5159 case BFD_RELOC_AARCH64_TLSDESC_ADR_PAGE21:
ce336788 5160 case BFD_RELOC_AARCH64_TLSGD_ADR_PAGE21:
a06ea964
NC		 5161 if (is_local)
5162 {
5163 /* GD->LE relaxation:
5164 adrp x0, :tlsgd:var => movz x0, :tprel_g1:var
5165 or
5166 adrp x0, :tlsdesc:var => movz x0, :tprel_g1:var
5167 */
5168 bfd_putl32 (0xd2a00000, contents + rel->r_offset);
5169 return bfd_reloc_continue;
5170 }
5171 else
5172 {
5173 /* GD->IE relaxation:
5174 adrp x0, :tlsgd:var => adrp x0, :gottprel:var
5175 or
5176 adrp x0, :tlsdesc:var => adrp x0, :gottprel:var
5177 */
a06ea964
NC		 5178 return bfd_reloc_continue;
5179 }
5180
389b8029
MS		 5181 case BFD_RELOC_AARCH64_TLSDESC_ADR_PREL21:
5182 BFD_ASSERT (0);
5183 break;
5184
1ada945d
MS		 5185 case BFD_RELOC_AARCH64_TLSDESC_LD_PREL19:
5186 if (is_local)
5187 {
5188 /* Tiny TLSDESC->LE relaxation:
5189 ldr x1, :tlsdesc:var => movz x0, #:tprel_g1:var
5190 adr x0, :tlsdesc:var => movk x0, #:tprel_g0_nc:var
5191 .tlsdesccall var
5192 blr x1 => nop
5193 */
5194 BFD_ASSERT (ELFNN_R_TYPE (rel[1].r_info) == AARCH64_R (TLSDESC_ADR_PREL21));
5195 BFD_ASSERT (ELFNN_R_TYPE (rel[2].r_info) == AARCH64_R (TLSDESC_CALL));
5196
5197 rel[1].r_info = ELFNN_R_INFO (ELFNN_R_SYM (rel->r_info),
5198 AARCH64_R (TLSLE_MOVW_TPREL_G0_NC));
5199 rel[2].r_info = ELFNN_R_INFO (STN_UNDEF, R_AARCH64_NONE);
5200
5201 bfd_putl32 (0xd2a00000, contents + rel->r_offset);
5202 bfd_putl32 (0xf2800000, contents + rel->r_offset + 4);
5203 bfd_putl32 (INSN_NOP, contents + rel->r_offset + 8);
5204 return bfd_reloc_continue;
5205 }
5206 else
5207 {
5208 /* Tiny TLSDESC->IE relaxation:
5209 ldr x1, :tlsdesc:var => ldr x0, :gottprel:var
5210 adr x0, :tlsdesc:var => nop
5211 .tlsdesccall var
5212 blr x1 => nop
5213 */
5214 BFD_ASSERT (ELFNN_R_TYPE (rel[1].r_info) == AARCH64_R (TLSDESC_ADR_PREL21));
5215 BFD_ASSERT (ELFNN_R_TYPE (rel[2].r_info) == AARCH64_R (TLSDESC_CALL));
5216
5217 rel[1].r_info = ELFNN_R_INFO (STN_UNDEF, R_AARCH64_NONE);
5218 rel[2].r_info = ELFNN_R_INFO (STN_UNDEF, R_AARCH64_NONE);
5219
5220 bfd_putl32 (0x58000000, contents + rel->r_offset);
5221 bfd_putl32 (INSN_NOP, contents + rel->r_offset + 4);
5222 bfd_putl32 (INSN_NOP, contents + rel->r_offset + 8);
5223 return bfd_reloc_continue;
5224 }
5225
3c12b054
MS		 5226 case BFD_RELOC_AARCH64_TLSGD_ADR_PREL21:
5227 if (is_local)
5228 {
5229 /* Tiny GD->LE relaxation:
5230 adr x0, :tlsgd:var => mrs x1, tpidr_el0
5231 bl __tls_get_addr => add x0, x1, #:tprel_hi12:x, lsl #12
5232 nop => add x0, x0, #:tprel_lo12_nc:x
5233 */
5234
5235 /* First kill the tls_get_addr reloc on the bl instruction. */
5236 BFD_ASSERT (rel->r_offset + 4 == rel[1].r_offset);
5237
5238 bfd_putl32 (0xd53bd041, contents + rel->r_offset + 0);
5239 bfd_putl32 (0x91400020, contents + rel->r_offset + 4);
5240 bfd_putl32 (0x91000000, contents + rel->r_offset + 8);
5241
5242 rel[1].r_info = ELFNN_R_INFO (ELFNN_R_SYM (rel->r_info),
5243 AARCH64_R (TLSLE_ADD_TPREL_LO12_NC));
5244 rel[1].r_offset = rel->r_offset + 8;
5245
5246 /* Move the current relocation to the second instruction in
5247 the sequence. */
5248 rel->r_offset += 4;
5249 rel->r_info = ELFNN_R_INFO (ELFNN_R_SYM (rel->r_info),
5250 AARCH64_R (TLSLE_ADD_TPREL_HI12));
5251 return bfd_reloc_continue;
5252 }
5253 else
5254 {
5255 /* Tiny GD->IE relaxation:
5256 adr x0, :tlsgd:var => ldr x0, :gottprel:var
5257 bl __tls_get_addr => mrs x1, tpidr_el0
5258 nop => add x0, x0, x1
5259 */
5260
5261 /* First kill the tls_get_addr reloc on the bl instruction. */
5262 BFD_ASSERT (rel->r_offset + 4 == rel[1].r_offset);
5263 rel[1].r_info = ELFNN_R_INFO (STN_UNDEF, R_AARCH64_NONE);
5264
5265 bfd_putl32 (0x58000000, contents + rel->r_offset);
5266 bfd_putl32 (0xd53bd041, contents + rel->r_offset + 4);
5267 bfd_putl32 (0x8b000020, contents + rel->r_offset + 8);
5268 return bfd_reloc_continue;
5269 }
5270
043bf05a
MS		 5271 case BFD_RELOC_AARCH64_TLSIE_LD_GOTTPREL_PREL19:
5272 return bfd_reloc_continue;
5273
a6bb11b2 5274 case BFD_RELOC_AARCH64_TLSDESC_LDNN_LO12_NC:
a06ea964
NC		 5275 if (is_local)
5276 {
5277 /* GD->LE relaxation:
5278 ldr xd, [x0, #:tlsdesc_lo12:var] => movk x0, :tprel_g0_nc:var
5279 */
5280 bfd_putl32 (0xf2800000, contents + rel->r_offset);
5281 return bfd_reloc_continue;
5282 }
5283 else
5284 {
5285 /* GD->IE relaxation:
5286 ldr xd, [x0, #:tlsdesc_lo12:var] => ldr x0, [x0, #:gottprel_lo12:var]
5287 */
5288 insn = bfd_getl32 (contents + rel->r_offset);
fa85fb9a 5289 insn &= 0xffffffe0;
a06ea964
NC		 5290 bfd_putl32 (insn, contents + rel->r_offset);
5291 return bfd_reloc_continue;
5292 }
5293
a6bb11b2 5294 case BFD_RELOC_AARCH64_TLSGD_ADD_LO12_NC:
a06ea964
NC		 5295 if (is_local)
5296 {
5297 /* GD->LE relaxation
5298 add x0, #:tlsgd_lo12:var => movk x0, :tprel_g0_nc:var
5299 bl __tls_get_addr => mrs x1, tpidr_el0
5300 nop => add x0, x1, x0
5301 */
5302
5303 /* First kill the tls_get_addr reloc on the bl instruction. */
5304 BFD_ASSERT (rel->r_offset + 4 == rel[1].r_offset);
cec5225b 5305 rel[1].r_info = ELFNN_R_INFO (STN_UNDEF, R_AARCH64_NONE);
a06ea964
NC		 5306
5307 bfd_putl32 (0xf2800000, contents + rel->r_offset);
5308 bfd_putl32 (0xd53bd041, contents + rel->r_offset + 4);
5309 bfd_putl32 (0x8b000020, contents + rel->r_offset + 8);
5310 return bfd_reloc_continue;
5311 }
5312 else
5313 {
5314 /* GD->IE relaxation
5315 ADD x0, #:tlsgd_lo12:var => ldr x0, [x0, #:gottprel_lo12:var]
5316 BL __tls_get_addr => mrs x1, tpidr_el0
5317 R_AARCH64_CALL26
5318 NOP => add x0, x1, x0
5319 */
5320
a6bb11b2 5321 BFD_ASSERT (ELFNN_R_TYPE (rel[1].r_info) == AARCH64_R (CALL26));
a06ea964
NC		 5322
5323 /* Remove the relocation on the BL instruction. */
cec5225b 5324 rel[1].r_info = ELFNN_R_INFO (STN_UNDEF, R_AARCH64_NONE);
a06ea964
NC		 5325
5326 bfd_putl32 (0xf9400000, contents + rel->r_offset);
5327
5328 /* We choose to fixup the BL and NOP instructions using the
5329 offset from the second relocation to allow flexibility in
5330 scheduling instructions between the ADD and BL. */
5331 bfd_putl32 (0xd53bd041, contents + rel[1].r_offset);
5332 bfd_putl32 (0x8b000020, contents + rel[1].r_offset + 4);
5333 return bfd_reloc_continue;
5334 }
5335
a6bb11b2
YZ		 5336 case BFD_RELOC_AARCH64_TLSDESC_ADD_LO12_NC:
5337 case BFD_RELOC_AARCH64_TLSDESC_CALL:
a06ea964
NC		 5338 /* GD->IE/LE relaxation:
5339 add x0, x0, #:tlsdesc_lo12:var => nop
5340 blr xd => nop
5341 */
5342 bfd_putl32 (INSN_NOP, contents + rel->r_offset);
5343 return bfd_reloc_ok;
5344
a6bb11b2 5345 case BFD_RELOC_AARCH64_TLSIE_ADR_GOTTPREL_PAGE21:
a06ea964
NC		 5346 /* IE->LE relaxation:
5347 adrp xd, :gottprel:var => movz xd, :tprel_g1:var
5348 */
5349 if (is_local)
5350 {
5351 insn = bfd_getl32 (contents + rel->r_offset);
5352 bfd_putl32 (0xd2a00000 | (insn & 0x1f), contents + rel->r_offset);
5353 }
5354 return bfd_reloc_continue;
5355
a6bb11b2 5356 case BFD_RELOC_AARCH64_TLSIE_LDNN_GOTTPREL_LO12_NC:
a06ea964
NC		 5357 /* IE->LE relaxation:
5358 ldr xd, [xm, #:gottprel_lo12:var] => movk xd, :tprel_g0_nc:var
5359 */
5360 if (is_local)
5361 {
5362 insn = bfd_getl32 (contents + rel->r_offset);
5363 bfd_putl32 (0xf2800000 | (insn & 0x1f), contents + rel->r_offset);
5364 }
5365 return bfd_reloc_continue;
5366
5367 default:
5368 return bfd_reloc_continue;
5369 }
5370
5371 return bfd_reloc_ok;
5372}
5373
5374/* Relocate an AArch64 ELF section. */
5375
5376static bfd_boolean
cec5225b 5377elfNN_aarch64_relocate_section (bfd *output_bfd,
a06ea964
NC		 5378 struct bfd_link_info *info,
5379 bfd *input_bfd,
5380 asection *input_section,
5381 bfd_byte *contents,
5382 Elf_Internal_Rela *relocs,
5383 Elf_Internal_Sym *local_syms,
5384 asection **local_sections)
5385{
5386 Elf_Internal_Shdr *symtab_hdr;
5387 struct elf_link_hash_entry **sym_hashes;
5388 Elf_Internal_Rela *rel;
5389 Elf_Internal_Rela *relend;
5390 const char *name;
cec5225b 5391 struct elf_aarch64_link_hash_table *globals;
a06ea964
NC		 5392 bfd_boolean save_addend = FALSE;
5393 bfd_vma addend = 0;
5394
cec5225b 5395 globals = elf_aarch64_hash_table (info);
a06ea964
NC		 5396
5397 symtab_hdr = &elf_symtab_hdr (input_bfd);
5398 sym_hashes = elf_sym_hashes (input_bfd);
5399
5400 rel = relocs;
5401 relend = relocs + input_section->reloc_count;
5402 for (; rel < relend; rel++)
5403 {
5404 unsigned int r_type;
a6bb11b2
YZ		 5405 bfd_reloc_code_real_type bfd_r_type;
5406 bfd_reloc_code_real_type relaxed_bfd_r_type;
a06ea964
NC		 5407 reloc_howto_type *howto;
5408 unsigned long r_symndx;
5409 Elf_Internal_Sym *sym;
5410 asection *sec;
5411 struct elf_link_hash_entry *h;
5412 bfd_vma relocation;
5413 bfd_reloc_status_type r;
5414 arelent bfd_reloc;
5415 char sym_type;
5416 bfd_boolean unresolved_reloc = FALSE;
5417 char *error_message = NULL;
5418
cec5225b
YZ		 5419 r_symndx = ELFNN_R_SYM (rel->r_info);
5420 r_type = ELFNN_R_TYPE (rel->r_info);
a06ea964 5421
cec5225b 5422 bfd_reloc.howto = elfNN_aarch64_howto_from_type (r_type);
a06ea964
NC		 5423 howto = bfd_reloc.howto;
5424
7fcfd62d
NC		 5425 if (howto == NULL)
5426 {
5427 (*_bfd_error_handler)
5428 (_("%B: unrecognized relocation (0x%x) in section `%A'"),
5429 input_bfd, input_section, r_type);
5430 return FALSE;
5431 }
a6bb11b2 5432 bfd_r_type = elfNN_aarch64_bfd_reloc_from_howto (howto);
7fcfd62d 5433
a06ea964
NC		 5434 h = NULL;
5435 sym = NULL;
5436 sec = NULL;
5437
5438 if (r_symndx < symtab_hdr->sh_info)
5439 {
5440 sym = local_syms + r_symndx;
cec5225b 5441 sym_type = ELFNN_ST_TYPE (sym->st_info);
a06ea964
NC		 5442 sec = local_sections[r_symndx];
5443
5444 /* An object file might have a reference to a local
5445 undefined symbol. This is a daft object file, but we
5446 should at least do something about it. */
5447 if (r_type != R_AARCH64_NONE && r_type != R_AARCH64_NULL
5448 && bfd_is_und_section (sec)
5449 && ELF_ST_BIND (sym->st_info) != STB_WEAK)
5450 {
5451 if (!info->callbacks->undefined_symbol
5452 (info, bfd_elf_string_from_elf_section
5453 (input_bfd, symtab_hdr->sh_link, sym->st_name),
5454 input_bfd, input_section, rel->r_offset, TRUE))
5455 return FALSE;
5456 }
5457
a06ea964 5458 relocation = _bfd_elf_rela_local_sym (output_bfd, sym, &sec, rel);
1419bbe5
WN		 5459
5460 /* Relocate against local STT_GNU_IFUNC symbol. */
5461 if (!info->relocatable
5462 && ELF_ST_TYPE (sym->st_info) == STT_GNU_IFUNC)
5463 {
5464 h = elfNN_aarch64_get_local_sym_hash (globals, input_bfd,
5465 rel, FALSE);
5466 if (h == NULL)
5467 abort ();
5468
5469 /* Set STT_GNU_IFUNC symbol value. */
5470 h->root.u.def.value = sym->st_value;
5471 h->root.u.def.section = sec;
5472 }
a06ea964
NC		 5473 }
5474 else
5475 {
62d887d4 5476 bfd_boolean warned, ignored;
a06ea964
NC		 5477
5478 RELOC_FOR_GLOBAL_SYMBOL (info, input_bfd, input_section, rel,
5479 r_symndx, symtab_hdr, sym_hashes,
5480 h, sec, relocation,
62d887d4 5481 unresolved_reloc, warned, ignored);
a06ea964
NC		 5482
5483 sym_type = h->type;
5484 }
5485
5486 if (sec != NULL && discarded_section (sec))
5487 RELOC_AGAINST_DISCARDED_SECTION (info, input_bfd, input_section,
5488 rel, 1, relend, howto, 0, contents);
5489
5490 if (info->relocatable)
2e0488d3 5491 continue;
a06ea964
NC		 5492
5493 if (h != NULL)
5494 name = h->root.root.string;
5495 else
5496 {
5497 name = (bfd_elf_string_from_elf_section
5498 (input_bfd, symtab_hdr->sh_link, sym->st_name));
5499 if (name == NULL || *name == '\0')
5500 name = bfd_section_name (input_bfd, sec);
5501 }
5502
5503 if (r_symndx != 0
5504 && r_type != R_AARCH64_NONE
5505 && r_type != R_AARCH64_NULL
5506 && (h == NULL
5507 || h->root.type == bfd_link_hash_defined
5508 || h->root.type == bfd_link_hash_defweak)
a6bb11b2 5509 && IS_AARCH64_TLS_RELOC (bfd_r_type) != (sym_type == STT_TLS))
a06ea964
NC		 5510 {
5511 (*_bfd_error_handler)
5512 ((sym_type == STT_TLS
5513 ? _("%B(%A+0x%lx): %s used with TLS symbol %s")
5514 : _("%B(%A+0x%lx): %s used with non-TLS symbol %s")),
5515 input_bfd,
5516 input_section, (long) rel->r_offset, howto->name, name);
5517 }
5518
a06ea964
NC		 5519 /* We relax only if we can see that there can be a valid transition
5520 from a reloc type to another.
cec5225b 5521 We call elfNN_aarch64_final_link_relocate unless we're completely
a06ea964
NC		 5522 done, i.e., the relaxation produced the final output we want. */
5523
a6bb11b2
YZ		 5524 relaxed_bfd_r_type = aarch64_tls_transition (input_bfd, info, r_type,
5525 h, r_symndx);
5526 if (relaxed_bfd_r_type != bfd_r_type)
a06ea964 5527 {
a6bb11b2
YZ		 5528 bfd_r_type = relaxed_bfd_r_type;
5529 howto = elfNN_aarch64_howto_from_bfd_reloc (bfd_r_type);
5530 BFD_ASSERT (howto != NULL);
5531 r_type = howto->type;
cec5225b 5532 r = elfNN_aarch64_tls_relax (globals, input_bfd, contents, rel, h);
a06ea964
NC		 5533 unresolved_reloc = 0;
5534 }
5535 else
5536 r = bfd_reloc_continue;
5537
5538 /* There may be multiple consecutive relocations for the
5539 same offset. In that case we are supposed to treat the
5540 output of each relocation as the addend for the next. */
5541 if (rel + 1 < relend
5542 && rel->r_offset == rel[1].r_offset
cec5225b
YZ		 5543 && ELFNN_R_TYPE (rel[1].r_info) != R_AARCH64_NONE
5544 && ELFNN_R_TYPE (rel[1].r_info) != R_AARCH64_NULL)
a06ea964
NC		 5545 save_addend = TRUE;
5546 else
5547 save_addend = FALSE;
5548
5549 if (r == bfd_reloc_continue)
cec5225b 5550 r = elfNN_aarch64_final_link_relocate (howto, input_bfd, output_bfd,
a06ea964
NC		 5551 input_section, contents, rel,
5552 relocation, info, sec,
5553 h, &unresolved_reloc,
1419bbe5 5554 save_addend, &addend, sym);
a06ea964 5555
a6bb11b2 5556 switch (elfNN_aarch64_bfd_reloc_from_type (r_type))
a06ea964 5557 {
ce336788 5558 case BFD_RELOC_AARCH64_TLSGD_ADD_LO12_NC:
a6bb11b2 5559 case BFD_RELOC_AARCH64_TLSGD_ADR_PAGE21:
3c12b054 5560 case BFD_RELOC_AARCH64_TLSGD_ADR_PREL21:
73f925cc 5561 case BFD_RELOC_AARCH64_TLSLD_ADD_LO12_NC:
f69e4920 5562 case BFD_RELOC_AARCH64_TLSLD_ADR_PAGE21:
77a69ff8 5563 case BFD_RELOC_AARCH64_TLSLD_ADR_PREL21:
a06ea964
NC		 5564 if (! symbol_got_offset_mark_p (input_bfd, h, r_symndx))
5565 {
5566 bfd_boolean need_relocs = FALSE;
5567 bfd_byte *loc;
5568 int indx;
5569 bfd_vma off;
5570
5571 off = symbol_got_offset (input_bfd, h, r_symndx);
5572 indx = h && h->dynindx != -1 ? h->dynindx : 0;
5573
5574 need_relocs =
5575 (info->shared || indx != 0) &&
5576 (h == NULL
5577 || ELF_ST_VISIBILITY (h->other) == STV_DEFAULT
5578 || h->root.type != bfd_link_hash_undefweak);
5579
5580 BFD_ASSERT (globals->root.srelgot != NULL);
5581
5582 if (need_relocs)
5583 {
5584 Elf_Internal_Rela rela;
a6bb11b2 5585 rela.r_info = ELFNN_R_INFO (indx, AARCH64_R (TLS_DTPMOD));
a06ea964
NC		 5586 rela.r_addend = 0;
5587 rela.r_offset = globals->root.sgot->output_section->vma +
5588 globals->root.sgot->output_offset + off;
5589
5590
5591 loc = globals->root.srelgot->contents;
5592 loc += globals->root.srelgot->reloc_count++
5593 * RELOC_SIZE (htab);
cec5225b 5594 bfd_elfNN_swap_reloca_out (output_bfd, &rela, loc);
a06ea964 5595
f69e4920
JW		 5596 bfd_reloc_code_real_type real_type =
5597 elfNN_aarch64_bfd_reloc_from_type (r_type);
5598
5599 if (real_type == BFD_RELOC_AARCH64_TLSLD_ADR_PREL21
73f925cc
JW		 5600 || real_type == BFD_RELOC_AARCH64_TLSLD_ADR_PAGE21
5601 || real_type == BFD_RELOC_AARCH64_TLSLD_ADD_LO12_NC)
77a69ff8
JW		 5602 {
5603 /* For local dynamic, don't generate DTPREL in any case.
5604 Initialize the DTPREL slot into zero, so we get module
5605 base address when invoke runtime TLS resolver. */
5606 bfd_put_NN (output_bfd, 0,
5607 globals->root.sgot->contents + off
5608 + GOT_ENTRY_SIZE);
5609 }
5610 else if (indx == 0)
a06ea964 5611 {
cec5225b 5612 bfd_put_NN (output_bfd,
a06ea964
NC		 5613 relocation - dtpoff_base (info),
5614 globals->root.sgot->contents + off
5615 + GOT_ENTRY_SIZE);
5616 }
5617 else
5618 {
5619 /* This TLS symbol is global. We emit a
5620 relocation to fixup the tls offset at load
5621 time. */
5622 rela.r_info =
a6bb11b2 5623 ELFNN_R_INFO (indx, AARCH64_R (TLS_DTPREL));
a06ea964
NC		 5624 rela.r_addend = 0;
5625 rela.r_offset =
5626 (globals->root.sgot->output_section->vma
5627 + globals->root.sgot->output_offset + off
5628 + GOT_ENTRY_SIZE);
5629
5630 loc = globals->root.srelgot->contents;
5631 loc += globals->root.srelgot->reloc_count++
5632 * RELOC_SIZE (globals);
cec5225b
YZ		 5633 bfd_elfNN_swap_reloca_out (output_bfd, &rela, loc);
5634 bfd_put_NN (output_bfd, (bfd_vma) 0,
a06ea964
NC		 5635 globals->root.sgot->contents + off
5636 + GOT_ENTRY_SIZE);
5637 }
5638 }
5639 else
5640 {
cec5225b 5641 bfd_put_NN (output_bfd, (bfd_vma) 1,
a06ea964 5642 globals->root.sgot->contents + off);
cec5225b 5643 bfd_put_NN (output_bfd,
a06ea964
NC		 5644 relocation - dtpoff_base (info),
5645 globals->root.sgot->contents + off
5646 + GOT_ENTRY_SIZE);
5647 }
5648
5649 symbol_got_offset_mark (input_bfd, h, r_symndx);
5650 }
5651 break;
5652
a6bb11b2
YZ		 5653 case BFD_RELOC_AARCH64_TLSIE_ADR_GOTTPREL_PAGE21:
5654 case BFD_RELOC_AARCH64_TLSIE_LDNN_GOTTPREL_LO12_NC:
043bf05a 5655 case BFD_RELOC_AARCH64_TLSIE_LD_GOTTPREL_PREL19:
a06ea964
NC		 5656 if (! symbol_got_offset_mark_p (input_bfd, h, r_symndx))
5657 {
5658 bfd_boolean need_relocs = FALSE;
5659 bfd_byte *loc;
5660 int indx;
5661 bfd_vma off;
5662
5663 off = symbol_got_offset (input_bfd, h, r_symndx);
5664
5665 indx = h && h->dynindx != -1 ? h->dynindx : 0;
5666
5667 need_relocs =
5668 (info->shared || indx != 0) &&
5669 (h == NULL
5670 || ELF_ST_VISIBILITY (h->other) == STV_DEFAULT
5671 || h->root.type != bfd_link_hash_undefweak);
5672
5673 BFD_ASSERT (globals->root.srelgot != NULL);
5674
5675 if (need_relocs)
5676 {
5677 Elf_Internal_Rela rela;
5678
5679 if (indx == 0)
5680 rela.r_addend = relocation - dtpoff_base (info);
5681 else
5682 rela.r_addend = 0;
5683
a6bb11b2 5684 rela.r_info = ELFNN_R_INFO (indx, AARCH64_R (TLS_TPREL));
a06ea964
NC		 5685 rela.r_offset = globals->root.sgot->output_section->vma +
5686 globals->root.sgot->output_offset + off;
5687
5688 loc = globals->root.srelgot->contents;
5689 loc += globals->root.srelgot->reloc_count++
5690 * RELOC_SIZE (htab);
5691
cec5225b 5692 bfd_elfNN_swap_reloca_out (output_bfd, &rela, loc);
a06ea964 5693
cec5225b 5694 bfd_put_NN (output_bfd, rela.r_addend,
a06ea964
NC		 5695 globals->root.sgot->contents + off);
5696 }
5697 else
cec5225b 5698 bfd_put_NN (output_bfd, relocation - tpoff_base (info),
a06ea964
NC		 5699 globals->root.sgot->contents + off);
5700
5701 symbol_got_offset_mark (input_bfd, h, r_symndx);
5702 }
5703 break;
5704
a6bb11b2 5705 case BFD_RELOC_AARCH64_TLSLE_ADD_TPREL_HI12:
ce336788 5706 case BFD_RELOC_AARCH64_TLSLE_ADD_TPREL_LO12:
a6bb11b2 5707 case BFD_RELOC_AARCH64_TLSLE_ADD_TPREL_LO12_NC:
a6bb11b2
YZ		 5708 case BFD_RELOC_AARCH64_TLSLE_MOVW_TPREL_G0:
5709 case BFD_RELOC_AARCH64_TLSLE_MOVW_TPREL_G0_NC:
ce336788
JW		 5710 case BFD_RELOC_AARCH64_TLSLE_MOVW_TPREL_G1:
5711 case BFD_RELOC_AARCH64_TLSLE_MOVW_TPREL_G1_NC:
5712 case BFD_RELOC_AARCH64_TLSLE_MOVW_TPREL_G2:
a06ea964
NC		 5713 break;
5714
7bcccb57 5715 case BFD_RELOC_AARCH64_TLSDESC_ADD_LO12_NC:
a6bb11b2 5716 case BFD_RELOC_AARCH64_TLSDESC_ADR_PAGE21:
389b8029 5717 case BFD_RELOC_AARCH64_TLSDESC_ADR_PREL21:
a6bb11b2 5718 case BFD_RELOC_AARCH64_TLSDESC_LDNN_LO12_NC:
1ada945d 5719 case BFD_RELOC_AARCH64_TLSDESC_LD_PREL19:
a06ea964
NC		 5720 if (! symbol_tlsdesc_got_offset_mark_p (input_bfd, h, r_symndx))
5721 {
5722 bfd_boolean need_relocs = FALSE;
5723 int indx = h && h->dynindx != -1 ? h->dynindx : 0;
5724 bfd_vma off = symbol_tlsdesc_got_offset (input_bfd, h, r_symndx);
5725
5726 need_relocs = (h == NULL
5727 || ELF_ST_VISIBILITY (h->other) == STV_DEFAULT
5728 || h->root.type != bfd_link_hash_undefweak);
5729
5730 BFD_ASSERT (globals->root.srelgot != NULL);
5731 BFD_ASSERT (globals->root.sgot != NULL);
5732
5733 if (need_relocs)
5734 {
5735 bfd_byte *loc;
5736 Elf_Internal_Rela rela;
a6bb11b2
YZ		 5737 rela.r_info = ELFNN_R_INFO (indx, AARCH64_R (TLSDESC));
5738
a06ea964
NC		 5739 rela.r_addend = 0;
5740 rela.r_offset = (globals->root.sgotplt->output_section->vma
5741 + globals->root.sgotplt->output_offset
5742 + off + globals->sgotplt_jump_table_size);
5743
5744 if (indx == 0)
5745 rela.r_addend = relocation - dtpoff_base (info);
5746
5747 /* Allocate the next available slot in the PLT reloc
5748 section to hold our R_AARCH64_TLSDESC, the next
5749 available slot is determined from reloc_count,
5750 which we step. But note, reloc_count was
5751 artifically moved down while allocating slots for
5752 real PLT relocs such that all of the PLT relocs
5753 will fit above the initial reloc_count and the
5754 extra stuff will fit below. */
5755 loc = globals->root.srelplt->contents;
5756 loc += globals->root.srelplt->reloc_count++
5757 * RELOC_SIZE (globals);
5758
cec5225b 5759 bfd_elfNN_swap_reloca_out (output_bfd, &rela, loc);
a06ea964 5760
cec5225b 5761 bfd_put_NN (output_bfd, (bfd_vma) 0,
a06ea964
NC		 5762 globals->root.sgotplt->contents + off +
5763 globals->sgotplt_jump_table_size);
cec5225b 5764 bfd_put_NN (output_bfd, (bfd_vma) 0,
a06ea964
NC		 5765 globals->root.sgotplt->contents + off +
5766 globals->sgotplt_jump_table_size +
5767 GOT_ENTRY_SIZE);
5768 }
5769
5770 symbol_tlsdesc_got_offset_mark (input_bfd, h, r_symndx);
5771 }
5772 break;
a6bb11b2
YZ		 5773 default:
5774 break;
a06ea964
NC		 5775 }
5776
5777 if (!save_addend)
5778 addend = 0;
5779
5780
5781 /* Dynamic relocs are not propagated for SEC_DEBUGGING sections
5782 because such sections are not SEC_ALLOC and thus ld.so will
5783 not process them. */
5784 if (unresolved_reloc
5785 && !((input_section->flags & SEC_DEBUGGING) != 0
5786 && h->def_dynamic)
5787 && _bfd_elf_section_offset (output_bfd, info, input_section,
5788 +rel->r_offset) != (bfd_vma) - 1)
5789 {
5790 (*_bfd_error_handler)
5791 (_
5792 ("%B(%A+0x%lx): unresolvable %s relocation against symbol `%s'"),
5793 input_bfd, input_section, (long) rel->r_offset, howto->name,
5794 h->root.root.string);
5795 return FALSE;
5796 }
5797
5798 if (r != bfd_reloc_ok && r != bfd_reloc_continue)
5799 {
5800 switch (r)
5801 {
5802 case bfd_reloc_overflow:
fdc3b1b1
JW		 5803 if (!(*info->callbacks->reloc_overflow)
5804 (info, (h ? &h->root : NULL), name, howto->name, (bfd_vma) 0,
5805 input_bfd, input_section, rel->r_offset))
a06ea964
NC		 5806 return FALSE;
5807 break;
5808
5809 case bfd_reloc_undefined:
5810 if (!((*info->callbacks->undefined_symbol)
5811 (info, name, input_bfd, input_section,
5812 rel->r_offset, TRUE)))
5813 return FALSE;
5814 break;
5815
5816 case bfd_reloc_outofrange:
5817 error_message = _("out of range");
5818 goto common_error;
5819
5820 case bfd_reloc_notsupported:
5821 error_message = _("unsupported relocation");
5822 goto common_error;
5823
5824 case bfd_reloc_dangerous:
5825 /* error_message should already be set. */
5826 goto common_error;
5827
5828 default:
5829 error_message = _("unknown error");
5830 /* Fall through. */
5831
5832 common_error:
5833 BFD_ASSERT (error_message != NULL);
5834 if (!((*info->callbacks->reloc_dangerous)
5835 (info, error_message, input_bfd, input_section,
5836 rel->r_offset)))
5837 return FALSE;
5838 break;
5839 }
5840 }
5841 }
5842
5843 return TRUE;
5844}
5845
5846/* Set the right machine number. */
5847
5848static bfd_boolean
cec5225b 5849elfNN_aarch64_object_p (bfd *abfd)
a06ea964 5850{
cec5225b
YZ		 5851#if ARCH_SIZE == 32
5852 bfd_default_set_arch_mach (abfd, bfd_arch_aarch64, bfd_mach_aarch64_ilp32);
5853#else
a06ea964 5854 bfd_default_set_arch_mach (abfd, bfd_arch_aarch64, bfd_mach_aarch64);
cec5225b 5855#endif
a06ea964
NC		 5856 return TRUE;
5857}
5858
5859/* Function to keep AArch64 specific flags in the ELF header. */
5860
5861static bfd_boolean
cec5225b 5862elfNN_aarch64_set_private_flags (bfd *abfd, flagword flags)
a06ea964
NC		 5863{
5864 if (elf_flags_init (abfd) && elf_elfheader (abfd)->e_flags != flags)
5865 {
5866 }
5867 else
5868 {
5869 elf_elfheader (abfd)->e_flags = flags;
5870 elf_flags_init (abfd) = TRUE;
5871 }
5872
5873 return TRUE;
5874}
5875
a06ea964
NC		 5876/* Merge backend specific data from an object file to the output
5877 object file when linking. */
5878
5879static bfd_boolean
cec5225b 5880elfNN_aarch64_merge_private_bfd_data (bfd *ibfd, bfd *obfd)
a06ea964
NC		 5881{
5882 flagword out_flags;
5883 flagword in_flags;
5884 bfd_boolean flags_compatible = TRUE;
5885 asection *sec;
5886
5887 /* Check if we have the same endianess. */
5888 if (!_bfd_generic_verify_endian_match (ibfd, obfd))
5889 return FALSE;
5890
5891 if (!is_aarch64_elf (ibfd) || !is_aarch64_elf (obfd))
5892 return TRUE;
5893
5894 /* The input BFD must have had its flags initialised. */
5895 /* The following seems bogus to me -- The flags are initialized in
5896 the assembler but I don't think an elf_flags_init field is
5897 written into the object. */
5898 /* BFD_ASSERT (elf_flags_init (ibfd)); */
5899
5900 in_flags = elf_elfheader (ibfd)->e_flags;
5901 out_flags = elf_elfheader (obfd)->e_flags;
5902
5903 if (!elf_flags_init (obfd))
5904 {
5905 /* If the input is the default architecture and had the default
5906 flags then do not bother setting the flags for the output
5907 architecture, instead allow future merges to do this. If no
5908 future merges ever set these flags then they will retain their
5909 uninitialised values, which surprise surprise, correspond
5910 to the default values. */
5911 if (bfd_get_arch_info (ibfd)->the_default
5912 && elf_elfheader (ibfd)->e_flags == 0)
5913 return TRUE;
5914
5915 elf_flags_init (obfd) = TRUE;
5916 elf_elfheader (obfd)->e_flags = in_flags;
5917
5918 if (bfd_get_arch (obfd) == bfd_get_arch (ibfd)
5919 && bfd_get_arch_info (obfd)->the_default)
5920 return bfd_set_arch_mach (obfd, bfd_get_arch (ibfd),
5921 bfd_get_mach (ibfd));
5922
5923 return TRUE;
5924 }
5925
5926 /* Identical flags must be compatible. */
5927 if (in_flags == out_flags)
5928 return TRUE;
5929
5930 /* Check to see if the input BFD actually contains any sections. If
5931 not, its flags may not have been initialised either, but it
5932 cannot actually cause any incompatiblity. Do not short-circuit
5933 dynamic objects; their section list may be emptied by
5934 elf_link_add_object_symbols.
5935
5936 Also check to see if there are no code sections in the input.
5937 In this case there is no need to check for code specific flags.
5938 XXX - do we need to worry about floating-point format compatability
5939 in data sections ? */
5940 if (!(ibfd->flags & DYNAMIC))
5941 {
5942 bfd_boolean null_input_bfd = TRUE;
5943 bfd_boolean only_data_sections = TRUE;
5944
5945 for (sec = ibfd->sections; sec != NULL; sec = sec->next)
5946 {
5947 if ((bfd_get_section_flags (ibfd, sec)
5948 & (SEC_LOAD | SEC_CODE | SEC_HAS_CONTENTS))
5949 == (SEC_LOAD | SEC_CODE | SEC_HAS_CONTENTS))
5950 only_data_sections = FALSE;
5951
5952 null_input_bfd = FALSE;
5953 break;
5954 }
5955
5956 if (null_input_bfd || only_data_sections)
5957 return TRUE;
5958 }
5959
5960 return flags_compatible;
5961}
5962
5963/* Display the flags field. */
5964
5965static bfd_boolean
cec5225b 5966elfNN_aarch64_print_private_bfd_data (bfd *abfd, void *ptr)
a06ea964
NC		 5967{
5968 FILE *file = (FILE *) ptr;
5969 unsigned long flags;
5970
5971 BFD_ASSERT (abfd != NULL && ptr != NULL);
5972
5973 /* Print normal ELF private data. */
5974 _bfd_elf_print_private_bfd_data (abfd, ptr);
5975
5976 flags = elf_elfheader (abfd)->e_flags;
5977 /* Ignore init flag - it may not be set, despite the flags field
5978 containing valid data. */
5979
5980 /* xgettext:c-format */
5981 fprintf (file, _("private flags = %lx:"), elf_elfheader (abfd)->e_flags);
5982
5983 if (flags)
5984 fprintf (file, _("<Unrecognised flag bits set>"));
5985
5986 fputc ('\n', file);
5987
5988 return TRUE;
5989}
5990
5991/* Update the got entry reference counts for the section being removed. */
5992
5993static bfd_boolean
cec5225b 5994elfNN_aarch64_gc_sweep_hook (bfd *abfd,
cb8af559
NC		 5995 struct bfd_link_info *info,
5996 asection *sec,
5997 const Elf_Internal_Rela * relocs)
a06ea964 5998{
cec5225b 5999 struct elf_aarch64_link_hash_table *htab;
59c108f7
NC		 6000 Elf_Internal_Shdr *symtab_hdr;
6001 struct elf_link_hash_entry **sym_hashes;
cb8af559 6002 struct elf_aarch64_local_symbol *locals;
59c108f7
NC		 6003 const Elf_Internal_Rela *rel, *relend;
6004
6005 if (info->relocatable)
6006 return TRUE;
6007
cec5225b 6008 htab = elf_aarch64_hash_table (info);
59c108f7
NC		 6009
6010 if (htab == NULL)
6011 return FALSE;
6012
6013 elf_section_data (sec)->local_dynrel = NULL;
6014
6015 symtab_hdr = &elf_symtab_hdr (abfd);
6016 sym_hashes = elf_sym_hashes (abfd);
6017
cec5225b 6018 locals = elf_aarch64_locals (abfd);
59c108f7
NC		 6019
6020 relend = relocs + sec->reloc_count;
6021 for (rel = relocs; rel < relend; rel++)
6022 {
6023 unsigned long r_symndx;
6024 unsigned int r_type;
6025 struct elf_link_hash_entry *h = NULL;
6026
cec5225b 6027 r_symndx = ELFNN_R_SYM (rel->r_info);
8847944f 6028
59c108f7
NC		 6029 if (r_symndx >= symtab_hdr->sh_info)
6030 {
8847944f 6031
59c108f7
NC		 6032 h = sym_hashes[r_symndx - symtab_hdr->sh_info];
6033 while (h->root.type == bfd_link_hash_indirect
6034 || h->root.type == bfd_link_hash_warning)
6035 h = (struct elf_link_hash_entry *) h->root.u.i.link;
59c108f7
NC		 6036 }
6037 else
6038 {
6039 Elf_Internal_Sym *isym;
6040
8847944f 6041 /* A local symbol. */
59c108f7
NC		 6042 isym = bfd_sym_from_r_symndx (&htab->sym_cache,
6043 abfd, r_symndx);
1419bbe5
WN		 6044
6045 /* Check relocation against local STT_GNU_IFUNC symbol. */
6046 if (isym != NULL
6047 && ELF_ST_TYPE (isym->st_info) == STT_GNU_IFUNC)
6048 {
6049 h = elfNN_aarch64_get_local_sym_hash (htab, abfd, rel, FALSE);
6050 if (h == NULL)
6051 abort ();
6052 }
6053 }
6054
6055 if (h)
6056 {
6057 struct elf_aarch64_link_hash_entry *eh;
6058 struct elf_dyn_relocs **pp;
6059 struct elf_dyn_relocs *p;
6060
6061 eh = (struct elf_aarch64_link_hash_entry *) h;
6062
6063 for (pp = &eh->dyn_relocs; (p = *pp) != NULL; pp = &p->next)
6064 if (p->sec == sec)
6065 {
6066 /* Everything must go for SEC. */
6067 *pp = p->next;
6068 break;
6069 }
59c108f7
NC		 6070 }
6071
cec5225b 6072 r_type = ELFNN_R_TYPE (rel->r_info);
a6bb11b2 6073 switch (aarch64_tls_transition (abfd,info, r_type, h ,r_symndx))
59c108f7 6074 {
a6bb11b2 6075 case BFD_RELOC_AARCH64_ADR_GOT_PAGE:
7bcccb57 6076 case BFD_RELOC_AARCH64_GOT_LD_PREL19:
7018c030 6077 case BFD_RELOC_AARCH64_LD32_GOTPAGE_LO14:
7bcccb57 6078 case BFD_RELOC_AARCH64_LD32_GOT_LO12_NC:
99ad26cb 6079 case BFD_RELOC_AARCH64_LD64_GOTPAGE_LO15:
7bcccb57
MS		 6080 case BFD_RELOC_AARCH64_LD64_GOT_LO12_NC:
6081 case BFD_RELOC_AARCH64_TLSDESC_ADD_LO12_NC:
6082 case BFD_RELOC_AARCH64_TLSDESC_ADR_PAGE21:
389b8029 6083 case BFD_RELOC_AARCH64_TLSDESC_ADR_PREL21:
7bcccb57
MS		 6084 case BFD_RELOC_AARCH64_TLSDESC_LD32_LO12_NC:
6085 case BFD_RELOC_AARCH64_TLSDESC_LD64_LO12_NC:
1ada945d 6086 case BFD_RELOC_AARCH64_TLSDESC_LD_PREL19:
a6bb11b2 6087 case BFD_RELOC_AARCH64_TLSGD_ADD_LO12_NC:
7bcccb57 6088 case BFD_RELOC_AARCH64_TLSGD_ADR_PAGE21:
3c12b054 6089 case BFD_RELOC_AARCH64_TLSGD_ADR_PREL21:
a6bb11b2 6090 case BFD_RELOC_AARCH64_TLSIE_ADR_GOTTPREL_PAGE21:
a6bb11b2 6091 case BFD_RELOC_AARCH64_TLSIE_LD32_GOTTPREL_LO12_NC:
7bcccb57 6092 case BFD_RELOC_AARCH64_TLSIE_LD64_GOTTPREL_LO12_NC:
043bf05a 6093 case BFD_RELOC_AARCH64_TLSIE_LD_GOTTPREL_PREL19:
73f925cc 6094 case BFD_RELOC_AARCH64_TLSLD_ADD_LO12_NC:
f69e4920 6095 case BFD_RELOC_AARCH64_TLSLD_ADR_PAGE21:
77a69ff8 6096 case BFD_RELOC_AARCH64_TLSLD_ADR_PREL21:
a6bb11b2 6097 case BFD_RELOC_AARCH64_TLSLE_ADD_TPREL_HI12:
7bcccb57 6098 case BFD_RELOC_AARCH64_TLSLE_ADD_TPREL_LO12:
a6bb11b2 6099 case BFD_RELOC_AARCH64_TLSLE_ADD_TPREL_LO12_NC:
a6bb11b2
YZ		 6100 case BFD_RELOC_AARCH64_TLSLE_MOVW_TPREL_G0:
6101 case BFD_RELOC_AARCH64_TLSLE_MOVW_TPREL_G0_NC:
7bcccb57
MS		 6102 case BFD_RELOC_AARCH64_TLSLE_MOVW_TPREL_G1:
6103 case BFD_RELOC_AARCH64_TLSLE_MOVW_TPREL_G1_NC:
6104 case BFD_RELOC_AARCH64_TLSLE_MOVW_TPREL_G2:
a6bb11b2 6105 if (h != NULL)
59c108f7
NC		 6106 {
6107 if (h->got.refcount > 0)
6108 h->got.refcount -= 1;
1419bbe5
WN		 6109
6110 if (h->type == STT_GNU_IFUNC)
6111 {
6112 if (h->plt.refcount > 0)
6113 h->plt.refcount -= 1;
6114 }
59c108f7 6115 }
cb8af559 6116 else if (locals != NULL)
59c108f7 6117 {
cb8af559
NC		 6118 if (locals[r_symndx].got_refcount > 0)
6119 locals[r_symndx].got_refcount -= 1;
59c108f7
NC		 6120 }
6121 break;
6122
a6bb11b2
YZ		 6123 case BFD_RELOC_AARCH64_CALL26:
6124 case BFD_RELOC_AARCH64_JUMP26:
6125 /* If this is a local symbol then we resolve it
6126 directly without creating a PLT entry. */
59c108f7
NC		 6127 if (h == NULL)
6128 continue;
6129
6130 if (h->plt.refcount > 0)
6131 h->plt.refcount -= 1;
6132 break;
6133
ce336788
JW		 6134 case BFD_RELOC_AARCH64_ADR_HI21_NC_PCREL:
6135 case BFD_RELOC_AARCH64_ADR_HI21_PCREL:
6136 case BFD_RELOC_AARCH64_ADR_LO21_PCREL:
614b09ce
JW		 6137 case BFD_RELOC_AARCH64_MOVW_G0_NC:
6138 case BFD_RELOC_AARCH64_MOVW_G1_NC:
6139 case BFD_RELOC_AARCH64_MOVW_G2_NC:
6140 case BFD_RELOC_AARCH64_MOVW_G3:
a6bb11b2 6141 case BFD_RELOC_AARCH64_NN:
8847944f 6142 if (h != NULL && info->executable)
59c108f7
NC		 6143 {
6144 if (h->plt.refcount > 0)
6145 h->plt.refcount -= 1;
6146 }
6147 break;
cec5225b 6148
59c108f7
NC		 6149 default:
6150 break;
6151 }
6152 }
6153
a06ea964
NC		 6154 return TRUE;
6155}
6156
6157/* Adjust a symbol defined by a dynamic object and referenced by a
6158 regular object. The current definition is in some section of the
6159 dynamic object, but we're not including those sections. We have to
6160 change the definition to something the rest of the link can
6161 understand. */
6162
6163static bfd_boolean
cec5225b 6164elfNN_aarch64_adjust_dynamic_symbol (struct bfd_link_info *info,
a06ea964
NC		 6165 struct elf_link_hash_entry *h)
6166{
cec5225b 6167 struct elf_aarch64_link_hash_table *htab;
a06ea964
NC		 6168 asection *s;
6169
6170 /* If this is a function, put it in the procedure linkage table. We
6171 will fill in the contents of the procedure linkage table later,
6172 when we know the address of the .got section. */
1419bbe5 6173 if (h->type == STT_FUNC || h->type == STT_GNU_IFUNC || h->needs_plt)
a06ea964
NC		 6174 {
6175 if (h->plt.refcount <= 0
1419bbe5
WN		 6176 || (h->type != STT_GNU_IFUNC
6177 && (SYMBOL_CALLS_LOCAL (info, h)
6178 || (ELF_ST_VISIBILITY (h->other) != STV_DEFAULT
6179 && h->root.type == bfd_link_hash_undefweak))))
a06ea964
NC		 6180 {
6181 /* This case can occur if we saw a CALL26 reloc in
6182 an input file, but the symbol wasn't referred to
6183 by a dynamic object or all references were
6184 garbage collected. In which case we can end up
6185 resolving. */
6186 h->plt.offset = (bfd_vma) - 1;
6187 h->needs_plt = 0;
6188 }
6189
6190 return TRUE;
6191 }
6192 else
80de0c6d 6193 /* Otherwise, reset to -1. */
a06ea964
NC		 6194 h->plt.offset = (bfd_vma) - 1;
6195
6196
6197 /* If this is a weak symbol, and there is a real definition, the
6198 processor independent code will have arranged for us to see the
6199 real definition first, and we can just use the same value. */
6200 if (h->u.weakdef != NULL)
6201 {
6202 BFD_ASSERT (h->u.weakdef->root.type == bfd_link_hash_defined
6203 || h->u.weakdef->root.type == bfd_link_hash_defweak);
6204 h->root.u.def.section = h->u.weakdef->root.u.def.section;
6205 h->root.u.def.value = h->u.weakdef->root.u.def.value;
6206 if (ELIMINATE_COPY_RELOCS || info->nocopyreloc)
6207 h->non_got_ref = h->u.weakdef->non_got_ref;
6208 return TRUE;
6209 }
6210
6211 /* If we are creating a shared library, we must presume that the
6212 only references to the symbol are via the global offset table.
6213 For such cases we need not do anything here; the relocations will
6214 be handled correctly by relocate_section. */
6215 if (info->shared)
6216 return TRUE;
6217
6218 /* If there are no references to this symbol that do not use the
6219 GOT, we don't need to generate a copy reloc. */
6220 if (!h->non_got_ref)
6221 return TRUE;
6222
6223 /* If -z nocopyreloc was given, we won't generate them either. */
6224 if (info->nocopyreloc)
6225 {
6226 h->non_got_ref = 0;
6227 return TRUE;
6228 }
6229
6230 /* We must allocate the symbol in our .dynbss section, which will
6231 become part of the .bss section of the executable. There will be
6232 an entry for this symbol in the .dynsym section. The dynamic
6233 object will contain position independent code, so all references
6234 from the dynamic object to this symbol will go through the global
6235 offset table. The dynamic linker will use the .dynsym entry to
6236 determine the address it must put in the global offset table, so
6237 both the dynamic object and the regular object will refer to the
6238 same memory location for the variable. */
6239
cec5225b 6240 htab = elf_aarch64_hash_table (info);
a06ea964
NC		 6241
6242 /* We must generate a R_AARCH64_COPY reloc to tell the dynamic linker
6243 to copy the initial value out of the dynamic object and into the
6244 runtime process image. */
6245 if ((h->root.u.def.section->flags & SEC_ALLOC) != 0 && h->size != 0)
6246 {
6247 htab->srelbss->size += RELOC_SIZE (htab);
6248 h->needs_copy = 1;
6249 }
6250
6251 s = htab->sdynbss;
6252
6cabe1ea 6253 return _bfd_elf_adjust_dynamic_copy (info, h, s);
a06ea964
NC		 6254
6255}
6256
6257static bfd_boolean
cec5225b 6258elfNN_aarch64_allocate_local_symbols (bfd *abfd, unsigned number)
a06ea964
NC		 6259{
6260 struct elf_aarch64_local_symbol *locals;
cec5225b 6261 locals = elf_aarch64_locals (abfd);
a06ea964
NC		 6262 if (locals == NULL)
6263 {
6264 locals = (struct elf_aarch64_local_symbol *)
6265 bfd_zalloc (abfd, number * sizeof (struct elf_aarch64_local_symbol));
6266 if (locals == NULL)
6267 return FALSE;
cec5225b 6268 elf_aarch64_locals (abfd) = locals;
a06ea964
NC		 6269 }
6270 return TRUE;
6271}
6272
cc0efaa8
MS		 6273/* Create the .got section to hold the global offset table. */
6274
6275static bfd_boolean
6276aarch64_elf_create_got_section (bfd *abfd, struct bfd_link_info *info)
6277{
6278 const struct elf_backend_data *bed = get_elf_backend_data (abfd);
6279 flagword flags;
6280 asection *s;
6281 struct elf_link_hash_entry *h;
6282 struct elf_link_hash_table *htab = elf_hash_table (info);
6283
6284 /* This function may be called more than once. */
6285 s = bfd_get_linker_section (abfd, ".got");
6286 if (s != NULL)
6287 return TRUE;
6288
6289 flags = bed->dynamic_sec_flags;
6290
6291 s = bfd_make_section_anyway_with_flags (abfd,
6292 (bed->rela_plts_and_copies_p
6293 ? ".rela.got" : ".rel.got"),
6294 (bed->dynamic_sec_flags
6295 | SEC_READONLY));
6296 if (s == NULL
6297 || ! bfd_set_section_alignment (abfd, s, bed->s->log_file_align))
6298 return FALSE;
6299 htab->srelgot = s;
6300
6301 s = bfd_make_section_anyway_with_flags (abfd, ".got", flags);
6302 if (s == NULL
6303 || !bfd_set_section_alignment (abfd, s, bed->s->log_file_align))
6304 return FALSE;
6305 htab->sgot = s;
6306 htab->sgot->size += GOT_ENTRY_SIZE;
6307
6308 if (bed->want_got_sym)
6309 {
6310 /* Define the symbol _GLOBAL_OFFSET_TABLE_ at the start of the .got
6311 (or .got.plt) section. We don't do this in the linker script
6312 because we don't want to define the symbol if we are not creating
6313 a global offset table. */
6314 h = _bfd_elf_define_linkage_sym (abfd, info, s,
6315 "_GLOBAL_OFFSET_TABLE_");
6316 elf_hash_table (info)->hgot = h;
6317 if (h == NULL)
6318 return FALSE;
6319 }
6320
6321 if (bed->want_got_plt)
6322 {
6323 s = bfd_make_section_anyway_with_flags (abfd, ".got.plt", flags);
6324 if (s == NULL
6325 || !bfd_set_section_alignment (abfd, s,
6326 bed->s->log_file_align))
6327 return FALSE;
6328 htab->sgotplt = s;
6329 }
6330
6331 /* The first bit of the global offset table is the header. */
6332 s->size += bed->got_header_size;
6333
6334 return TRUE;
6335}
6336
a06ea964
NC		 6337/* Look through the relocs for a section during the first phase. */
6338
6339static bfd_boolean
cec5225b 6340elfNN_aarch64_check_relocs (bfd *abfd, struct bfd_link_info *info,
a06ea964
NC		 6341 asection *sec, const Elf_Internal_Rela *relocs)
6342{
6343 Elf_Internal_Shdr *symtab_hdr;
6344 struct elf_link_hash_entry **sym_hashes;
6345 const Elf_Internal_Rela *rel;
6346 const Elf_Internal_Rela *rel_end;
6347 asection *sreloc;
6348
cec5225b 6349 struct elf_aarch64_link_hash_table *htab;
a06ea964 6350
a06ea964
NC		 6351 if (info->relocatable)
6352 return TRUE;
6353
6354 BFD_ASSERT (is_aarch64_elf (abfd));
6355
cec5225b 6356 htab = elf_aarch64_hash_table (info);
a06ea964
NC		 6357 sreloc = NULL;
6358
6359 symtab_hdr = &elf_symtab_hdr (abfd);
6360 sym_hashes = elf_sym_hashes (abfd);
a06ea964
NC		 6361
6362 rel_end = relocs + sec->reloc_count;
6363 for (rel = relocs; rel < rel_end; rel++)
6364 {
6365 struct elf_link_hash_entry *h;
6366 unsigned long r_symndx;
6367 unsigned int r_type;
a6bb11b2 6368 bfd_reloc_code_real_type bfd_r_type;
1419bbe5 6369 Elf_Internal_Sym *isym;
a06ea964 6370
cec5225b
YZ		 6371 r_symndx = ELFNN_R_SYM (rel->r_info);
6372 r_type = ELFNN_R_TYPE (rel->r_info);
a06ea964
NC		 6373
6374 if (r_symndx >= NUM_SHDR_ENTRIES (symtab_hdr))
6375 {
6376 (*_bfd_error_handler) (_("%B: bad symbol index: %d"), abfd,
6377 r_symndx);
6378 return FALSE;
6379 }
6380
ed5acf27 6381 if (r_symndx < symtab_hdr->sh_info)
1419bbe5
WN		 6382 {
6383 /* A local symbol. */
6384 isym = bfd_sym_from_r_symndx (&htab->sym_cache,
6385 abfd, r_symndx);
6386 if (isym == NULL)
6387 return FALSE;
6388
6389 /* Check relocation against local STT_GNU_IFUNC symbol. */
6390 if (ELF_ST_TYPE (isym->st_info) == STT_GNU_IFUNC)
6391 {
6392 h = elfNN_aarch64_get_local_sym_hash (htab, abfd, rel,
6393 TRUE);
6394 if (h == NULL)
6395 return FALSE;
6396
6397 /* Fake a STT_GNU_IFUNC symbol. */
6398 h->type = STT_GNU_IFUNC;
6399 h->def_regular = 1;
6400 h->ref_regular = 1;
6401 h->forced_local = 1;
6402 h->root.type = bfd_link_hash_defined;
6403 }
6404 else
6405 h = NULL;
6406 }
a06ea964
NC		 6407 else
6408 {
6409 h = sym_hashes[r_symndx - symtab_hdr->sh_info];
6410 while (h->root.type == bfd_link_hash_indirect
6411 || h->root.type == bfd_link_hash_warning)
6412 h = (struct elf_link_hash_entry *) h->root.u.i.link;
81fbe831
AM		 6413
6414 /* PR15323, ref flags aren't set for references in the same
6415 object. */
6416 h->root.non_ir_ref = 1;
a06ea964
NC		 6417 }
6418
6419 /* Could be done earlier, if h were already available. */
a6bb11b2 6420 bfd_r_type = aarch64_tls_transition (abfd, info, r_type, h, r_symndx);
a06ea964 6421
1419bbe5
WN		 6422 if (h != NULL)
6423 {
6424 /* Create the ifunc sections for static executables. If we
6425 never see an indirect function symbol nor we are building
6426 a static executable, those sections will be empty and
6427 won't appear in output. */
6428 switch (bfd_r_type)
6429 {
6430 default:
6431 break;
6432
ce336788
JW		 6433 case BFD_RELOC_AARCH64_ADD_LO12:
6434 case BFD_RELOC_AARCH64_ADR_GOT_PAGE:
6435 case BFD_RELOC_AARCH64_ADR_HI21_PCREL:
1419bbe5 6436 case BFD_RELOC_AARCH64_CALL26:
ce336788 6437 case BFD_RELOC_AARCH64_GOT_LD_PREL19:
1419bbe5 6438 case BFD_RELOC_AARCH64_JUMP26:
7018c030 6439 case BFD_RELOC_AARCH64_LD32_GOTPAGE_LO14:
1419bbe5 6440 case BFD_RELOC_AARCH64_LD32_GOT_LO12_NC:
99ad26cb 6441 case BFD_RELOC_AARCH64_LD64_GOTPAGE_LO15:
1419bbe5 6442 case BFD_RELOC_AARCH64_LD64_GOT_LO12_NC:
ce336788 6443 case BFD_RELOC_AARCH64_NN:
1419bbe5
WN		 6444 if (htab->root.dynobj == NULL)
6445 htab->root.dynobj = abfd;
6446 if (!_bfd_elf_create_ifunc_sections (htab->root.dynobj, info))
6447 return FALSE;
6448 break;
6449 }
6450
6451 /* It is referenced by a non-shared object. */
6452 h->ref_regular = 1;
6453 h->root.non_ir_ref = 1;
6454 }
6455
a6bb11b2 6456 switch (bfd_r_type)
a06ea964 6457 {
a6bb11b2 6458 case BFD_RELOC_AARCH64_NN:
a06ea964
NC		 6459
6460 /* We don't need to handle relocs into sections not going into
6461 the "real" output. */
6462 if ((sec->flags & SEC_ALLOC) == 0)
6463 break;
6464
6465 if (h != NULL)
6466 {
6467 if (!info->shared)
6468 h->non_got_ref = 1;
6469
6470 h->plt.refcount += 1;
6471 h->pointer_equality_needed = 1;
6472 }
6473
6474 /* No need to do anything if we're not creating a shared
6475 object. */
6476 if (! info->shared)
6477 break;
6478
6479 {
6480 struct elf_dyn_relocs *p;
6481 struct elf_dyn_relocs **head;
6482
6483 /* We must copy these reloc types into the output file.
6484 Create a reloc section in dynobj and make room for
6485 this reloc. */
6486 if (sreloc == NULL)
6487 {
6488 if (htab->root.dynobj == NULL)
6489 htab->root.dynobj = abfd;
6490
6491 sreloc = _bfd_elf_make_dynamic_reloc_section
0608afa7 6492 (sec, htab->root.dynobj, LOG_FILE_ALIGN, abfd, /*rela? */ TRUE);
a06ea964
NC		 6493
6494 if (sreloc == NULL)
6495 return FALSE;
6496 }
6497
6498 /* If this is a global symbol, we count the number of
6499 relocations we need for this symbol. */
6500 if (h != NULL)
6501 {
cec5225b
YZ		 6502 struct elf_aarch64_link_hash_entry *eh;
6503 eh = (struct elf_aarch64_link_hash_entry *) h;
a06ea964
NC		 6504 head = &eh->dyn_relocs;
6505 }
6506 else
6507 {
6508 /* Track dynamic relocs needed for local syms too.
6509 We really need local syms available to do this
6510 easily. Oh well. */
6511
6512 asection *s;
6513 void **vpp;
a06ea964
NC		 6514
6515 isym = bfd_sym_from_r_symndx (&htab->sym_cache,
6516 abfd, r_symndx);
6517 if (isym == NULL)
6518 return FALSE;
6519
6520 s = bfd_section_from_elf_index (abfd, isym->st_shndx);
6521 if (s == NULL)
6522 s = sec;
6523
6524 /* Beware of type punned pointers vs strict aliasing
6525 rules. */
6526 vpp = &(elf_section_data (s)->local_dynrel);
6527 head = (struct elf_dyn_relocs **) vpp;
6528 }
6529
6530 p = *head;
6531 if (p == NULL || p->sec != sec)
6532 {
6533 bfd_size_type amt = sizeof *p;
6534 p = ((struct elf_dyn_relocs *)
6535 bfd_zalloc (htab->root.dynobj, amt));
6536 if (p == NULL)
6537 return FALSE;
6538 p->next = *head;
6539 *head = p;
6540 p->sec = sec;
6541 }
6542
6543 p->count += 1;
6544
6545 }
6546 break;
6547
6548 /* RR: We probably want to keep a consistency check that
6549 there are no dangling GOT_PAGE relocs. */
a6bb11b2 6550 case BFD_RELOC_AARCH64_ADR_GOT_PAGE:
7bcccb57 6551 case BFD_RELOC_AARCH64_GOT_LD_PREL19:
7018c030 6552 case BFD_RELOC_AARCH64_LD32_GOTPAGE_LO14:
7bcccb57 6553 case BFD_RELOC_AARCH64_LD32_GOT_LO12_NC:
99ad26cb 6554 case BFD_RELOC_AARCH64_LD64_GOTPAGE_LO15:
7bcccb57
MS		 6555 case BFD_RELOC_AARCH64_LD64_GOT_LO12_NC:
6556 case BFD_RELOC_AARCH64_TLSDESC_ADD_LO12_NC:
6557 case BFD_RELOC_AARCH64_TLSDESC_ADR_PAGE21:
389b8029 6558 case BFD_RELOC_AARCH64_TLSDESC_ADR_PREL21:
7bcccb57
MS		 6559 case BFD_RELOC_AARCH64_TLSDESC_LD32_LO12_NC:
6560 case BFD_RELOC_AARCH64_TLSDESC_LD64_LO12_NC:
1ada945d 6561 case BFD_RELOC_AARCH64_TLSDESC_LD_PREL19:
a6bb11b2 6562 case BFD_RELOC_AARCH64_TLSGD_ADD_LO12_NC:
7bcccb57 6563 case BFD_RELOC_AARCH64_TLSGD_ADR_PAGE21:
3c12b054 6564 case BFD_RELOC_AARCH64_TLSGD_ADR_PREL21:
a6bb11b2 6565 case BFD_RELOC_AARCH64_TLSIE_ADR_GOTTPREL_PAGE21:
a6bb11b2 6566 case BFD_RELOC_AARCH64_TLSIE_LD32_GOTTPREL_LO12_NC:
7bcccb57 6567 case BFD_RELOC_AARCH64_TLSIE_LD64_GOTTPREL_LO12_NC:
043bf05a 6568 case BFD_RELOC_AARCH64_TLSIE_LD_GOTTPREL_PREL19:
73f925cc 6569 case BFD_RELOC_AARCH64_TLSLD_ADD_LO12_NC:
f69e4920 6570 case BFD_RELOC_AARCH64_TLSLD_ADR_PAGE21:
77a69ff8 6571 case BFD_RELOC_AARCH64_TLSLD_ADR_PREL21:
a6bb11b2 6572 case BFD_RELOC_AARCH64_TLSLE_ADD_TPREL_HI12:
7bcccb57 6573 case BFD_RELOC_AARCH64_TLSLE_ADD_TPREL_LO12:
a6bb11b2 6574 case BFD_RELOC_AARCH64_TLSLE_ADD_TPREL_LO12_NC:
a6bb11b2
YZ		 6575 case BFD_RELOC_AARCH64_TLSLE_MOVW_TPREL_G0:
6576 case BFD_RELOC_AARCH64_TLSLE_MOVW_TPREL_G0_NC:
7bcccb57
MS		 6577 case BFD_RELOC_AARCH64_TLSLE_MOVW_TPREL_G1:
6578 case BFD_RELOC_AARCH64_TLSLE_MOVW_TPREL_G1_NC:
6579 case BFD_RELOC_AARCH64_TLSLE_MOVW_TPREL_G2:
a06ea964
NC		 6580 {
6581 unsigned got_type;
6582 unsigned old_got_type;
6583
a6bb11b2 6584 got_type = aarch64_reloc_got_type (bfd_r_type);
a06ea964
NC		 6585
6586 if (h)
6587 {
6588 h->got.refcount += 1;
cec5225b 6589 old_got_type = elf_aarch64_hash_entry (h)->got_type;
a06ea964
NC		 6590 }
6591 else
6592 {
6593 struct elf_aarch64_local_symbol *locals;
6594
cec5225b 6595 if (!elfNN_aarch64_allocate_local_symbols
a06ea964
NC		 6596 (abfd, symtab_hdr->sh_info))
6597 return FALSE;
6598
cec5225b 6599 locals = elf_aarch64_locals (abfd);
a06ea964
NC		 6600 BFD_ASSERT (r_symndx < symtab_hdr->sh_info);
6601 locals[r_symndx].got_refcount += 1;
6602 old_got_type = locals[r_symndx].got_type;
6603 }
6604
6605 /* If a variable is accessed with both general dynamic TLS
6606 methods, two slots may be created. */
6607 if (GOT_TLS_GD_ANY_P (old_got_type) && GOT_TLS_GD_ANY_P (got_type))
6608 got_type |= old_got_type;
6609
6610 /* We will already have issued an error message if there
6611 is a TLS/non-TLS mismatch, based on the symbol type.
6612 So just combine any TLS types needed. */
6613 if (old_got_type != GOT_UNKNOWN && old_got_type != GOT_NORMAL
6614 && got_type != GOT_NORMAL)
6615 got_type |= old_got_type;
6616
6617 /* If the symbol is accessed by both IE and GD methods, we
6618 are able to relax. Turn off the GD flag, without
6619 messing up with any other kind of TLS types that may be
6620 involved. */
6621 if ((got_type & GOT_TLS_IE) && GOT_TLS_GD_ANY_P (got_type))
6622 got_type &= ~ (GOT_TLSDESC_GD | GOT_TLS_GD);
6623
6624 if (old_got_type != got_type)
6625 {
6626 if (h != NULL)
cec5225b 6627 elf_aarch64_hash_entry (h)->got_type = got_type;
a06ea964
NC		 6628 else
6629 {
6630 struct elf_aarch64_local_symbol *locals;
cec5225b 6631 locals = elf_aarch64_locals (abfd);
a06ea964
NC		 6632 BFD_ASSERT (r_symndx < symtab_hdr->sh_info);
6633 locals[r_symndx].got_type = got_type;
6634 }
6635 }
6636
cc0efaa8
MS		 6637 if (htab->root.dynobj == NULL)
6638 htab->root.dynobj = abfd;
6639 if (! aarch64_elf_create_got_section (htab->root.dynobj, info))
6640 return FALSE;
a06ea964
NC		 6641 break;
6642 }
6643
614b09ce
JW		 6644 case BFD_RELOC_AARCH64_MOVW_G0_NC:
6645 case BFD_RELOC_AARCH64_MOVW_G1_NC:
6646 case BFD_RELOC_AARCH64_MOVW_G2_NC:
6647 case BFD_RELOC_AARCH64_MOVW_G3:
6648 if (info->shared)
6649 {
6650 int howto_index = bfd_r_type - BFD_RELOC_AARCH64_RELOC_START;
6651 (*_bfd_error_handler)
6652 (_("%B: relocation %s against `%s' can not be used when making "
6653 "a shared object; recompile with -fPIC"),
6654 abfd, elfNN_aarch64_howto_table[howto_index].name,
6655 (h) ? h->root.root.string : "a local symbol");
6656 bfd_set_error (bfd_error_bad_value);
6657 return FALSE;
6658 }
6659
a6bb11b2
YZ		 6660 case BFD_RELOC_AARCH64_ADR_HI21_NC_PCREL:
6661 case BFD_RELOC_AARCH64_ADR_HI21_PCREL:
6662 case BFD_RELOC_AARCH64_ADR_LO21_PCREL:
a06ea964
NC		 6663 if (h != NULL && info->executable)
6664 {
6665 /* If this reloc is in a read-only section, we might
6666 need a copy reloc. We can't check reliably at this
6667 stage whether the section is read-only, as input
6668 sections have not yet been mapped to output sections.
6669 Tentatively set the flag for now, and correct in
6670 adjust_dynamic_symbol. */
6671 h->non_got_ref = 1;
6672 h->plt.refcount += 1;
6673 h->pointer_equality_needed = 1;
6674 }
6675 /* FIXME:: RR need to handle these in shared libraries
6676 and essentially bomb out as these being non-PIC
6677 relocations in shared libraries. */
6678 break;
6679
a6bb11b2
YZ		 6680 case BFD_RELOC_AARCH64_CALL26:
6681 case BFD_RELOC_AARCH64_JUMP26:
a06ea964
NC		 6682 /* If this is a local symbol then we resolve it
6683 directly without creating a PLT entry. */
6684 if (h == NULL)
6685 continue;
6686
6687 h->needs_plt = 1;
1419bbe5
WN		 6688 if (h->plt.refcount <= 0)
6689 h->plt.refcount = 1;
6690 else
6691 h->plt.refcount += 1;
a06ea964 6692 break;
a6bb11b2
YZ		 6693
6694 default:
6695 break;
a06ea964
NC		 6696 }
6697 }
a6bb11b2 6698
a06ea964
NC		 6699 return TRUE;
6700}
6701
6702/* Treat mapping symbols as special target symbols. */
6703
6704static bfd_boolean
cec5225b 6705elfNN_aarch64_is_target_special_symbol (bfd *abfd ATTRIBUTE_UNUSED,
a06ea964
NC		 6706 asymbol *sym)
6707{
6708 return bfd_is_aarch64_special_symbol_name (sym->name,
6709 BFD_AARCH64_SPECIAL_SYM_TYPE_ANY);
6710}
6711
6712/* This is a copy of elf_find_function () from elf.c except that
6713 AArch64 mapping symbols are ignored when looking for function names. */
6714
6715static bfd_boolean
6716aarch64_elf_find_function (bfd *abfd ATTRIBUTE_UNUSED,
a06ea964 6717 asymbol **symbols,
fb167eb2 6718 asection *section,
a06ea964
NC		 6719 bfd_vma offset,
6720 const char **filename_ptr,
6721 const char **functionname_ptr)
6722{
6723 const char *filename = NULL;
6724 asymbol *func = NULL;
6725 bfd_vma low_func = 0;
6726 asymbol **p;
6727
6728 for (p = symbols; *p != NULL; p++)
6729 {
6730 elf_symbol_type *q;
6731
6732 q = (elf_symbol_type *) * p;
6733
6734 switch (ELF_ST_TYPE (q->internal_elf_sym.st_info))
6735 {
6736 default:
6737 break;
6738 case STT_FILE:
6739 filename = bfd_asymbol_name (&q->symbol);
6740 break;
6741 case STT_FUNC:
6742 case STT_NOTYPE:
6743 /* Skip mapping symbols. */
6744 if ((q->symbol.flags & BSF_LOCAL)
6745 && (bfd_is_aarch64_special_symbol_name
6746 (q->symbol.name, BFD_AARCH64_SPECIAL_SYM_TYPE_ANY)))
6747 continue;
6748 /* Fall through. */
6749 if (bfd_get_section (&q->symbol) == section
6750 && q->symbol.value >= low_func && q->symbol.value <= offset)
6751 {
6752 func = (asymbol *) q;
6753 low_func = q->symbol.value;
6754 }
6755 break;
6756 }
6757 }
6758
6759 if (func == NULL)
6760 return FALSE;
6761
6762 if (filename_ptr)
6763 *filename_ptr = filename;
6764 if (functionname_ptr)
6765 *functionname_ptr = bfd_asymbol_name (func);
6766
6767 return TRUE;
6768}
6769
6770
6771/* Find the nearest line to a particular section and offset, for error
6772 reporting. This code is a duplicate of the code in elf.c, except
6773 that it uses aarch64_elf_find_function. */
6774
6775static bfd_boolean
cec5225b 6776elfNN_aarch64_find_nearest_line (bfd *abfd,
a06ea964 6777 asymbol **symbols,
fb167eb2 6778 asection *section,
a06ea964
NC		 6779 bfd_vma offset,
6780 const char **filename_ptr,
6781 const char **functionname_ptr,
fb167eb2
AM		 6782 unsigned int *line_ptr,
6783 unsigned int *discriminator_ptr)
a06ea964
NC		 6784{
6785 bfd_boolean found = FALSE;
6786
fb167eb2 6787 if (_bfd_dwarf2_find_nearest_line (abfd, symbols, NULL, section, offset,
a06ea964 6788 filename_ptr, functionname_ptr,
fb167eb2
AM		 6789 line_ptr, discriminator_ptr,
6790 dwarf_debug_sections, 0,
a06ea964
NC		 6791 &elf_tdata (abfd)->dwarf2_find_line_info))
6792 {
6793 if (!*functionname_ptr)
fb167eb2 6794 aarch64_elf_find_function (abfd, symbols, section, offset,
a06ea964
NC		 6795 *filename_ptr ? NULL : filename_ptr,
6796 functionname_ptr);
6797
6798 return TRUE;
6799 }
6800
fb167eb2
AM		 6801 /* Skip _bfd_dwarf1_find_nearest_line since no known AArch64
6802 toolchain uses DWARF1. */
6803
a06ea964
NC		 6804 if (!_bfd_stab_section_find_nearest_line (abfd, symbols, section, offset,
6805 &found, filename_ptr,
6806 functionname_ptr, line_ptr,
6807 &elf_tdata (abfd)->line_info))
6808 return FALSE;
6809
6810 if (found && (*functionname_ptr || *line_ptr))
6811 return TRUE;
6812
6813 if (symbols == NULL)
6814 return FALSE;
6815
fb167eb2 6816 if (!aarch64_elf_find_function (abfd, symbols, section, offset,
a06ea964
NC		 6817 filename_ptr, functionname_ptr))
6818 return FALSE;
6819
6820 *line_ptr = 0;
6821 return TRUE;
6822}
6823
6824static bfd_boolean
cec5225b 6825elfNN_aarch64_find_inliner_info (bfd *abfd,
a06ea964
NC		 6826 const char **filename_ptr,
6827 const char **functionname_ptr,
6828 unsigned int *line_ptr)
6829{
6830 bfd_boolean found;
6831 found = _bfd_dwarf2_find_inliner_info
6832 (abfd, filename_ptr,
6833 functionname_ptr, line_ptr, &elf_tdata (abfd)->dwarf2_find_line_info);
6834 return found;
6835}
6836
6837
6838static void
cec5225b 6839elfNN_aarch64_post_process_headers (bfd *abfd,
1419bbe5 6840 struct bfd_link_info *link_info)
a06ea964
NC		 6841{
6842 Elf_Internal_Ehdr *i_ehdrp; /* ELF file header, internal form. */
6843
6844 i_ehdrp = elf_elfheader (abfd);
a06ea964 6845 i_ehdrp->e_ident[EI_ABIVERSION] = AARCH64_ELF_ABI_VERSION;
1419bbe5 6846
78245035 6847 _bfd_elf_post_process_headers (abfd, link_info);
a06ea964
NC		 6848}
6849
6850static enum elf_reloc_type_class
cec5225b 6851elfNN_aarch64_reloc_type_class (const struct bfd_link_info *info ATTRIBUTE_UNUSED,
7e612e98
AM		 6852 const asection *rel_sec ATTRIBUTE_UNUSED,
6853 const Elf_Internal_Rela *rela)
a06ea964 6854{
cec5225b 6855 switch ((int) ELFNN_R_TYPE (rela->r_info))
a06ea964 6856 {
a6bb11b2 6857 case AARCH64_R (RELATIVE):
a06ea964 6858 return reloc_class_relative;
a6bb11b2 6859 case AARCH64_R (JUMP_SLOT):
a06ea964 6860 return reloc_class_plt;
a6bb11b2 6861 case AARCH64_R (COPY):
a06ea964
NC		 6862 return reloc_class_copy;
6863 default:
6864 return reloc_class_normal;
6865 }
6866}
6867
a06ea964
NC		 6868/* Handle an AArch64 specific section when reading an object file. This is
6869 called when bfd_section_from_shdr finds a section with an unknown
6870 type. */
6871
6872static bfd_boolean
cec5225b 6873elfNN_aarch64_section_from_shdr (bfd *abfd,
a06ea964
NC		 6874 Elf_Internal_Shdr *hdr,
6875 const char *name, int shindex)
6876{
6877 /* There ought to be a place to keep ELF backend specific flags, but
6878 at the moment there isn't one. We just keep track of the
6879 sections by their name, instead. Fortunately, the ABI gives
6880 names for all the AArch64 specific sections, so we will probably get
6881 away with this. */
6882 switch (hdr->sh_type)
6883 {
6884 case SHT_AARCH64_ATTRIBUTES:
6885 break;
6886
6887 default:
6888 return FALSE;
6889 }
6890
6891 if (!_bfd_elf_make_section_from_shdr (abfd, hdr, name, shindex))
6892 return FALSE;
6893
6894 return TRUE;
6895}
6896
6897/* A structure used to record a list of sections, independently
6898 of the next and prev fields in the asection structure. */
6899typedef struct section_list
6900{
6901 asection *sec;
6902 struct section_list *next;
6903 struct section_list *prev;
6904}
6905section_list;
6906
6907/* Unfortunately we need to keep a list of sections for which
6908 an _aarch64_elf_section_data structure has been allocated. This
cec5225b 6909 is because it is possible for functions like elfNN_aarch64_write_section
a06ea964
NC		 6910 to be called on a section which has had an elf_data_structure
6911 allocated for it (and so the used_by_bfd field is valid) but
6912 for which the AArch64 extended version of this structure - the
6913 _aarch64_elf_section_data structure - has not been allocated. */
6914static section_list *sections_with_aarch64_elf_section_data = NULL;
6915
6916static void
6917record_section_with_aarch64_elf_section_data (asection *sec)
6918{
6919 struct section_list *entry;
6920
6921 entry = bfd_malloc (sizeof (*entry));
6922 if (entry == NULL)
6923 return;
6924 entry->sec = sec;
6925 entry->next = sections_with_aarch64_elf_section_data;
6926 entry->prev = NULL;
6927 if (entry->next != NULL)
6928 entry->next->prev = entry;
6929 sections_with_aarch64_elf_section_data = entry;
6930}
6931
6932static struct section_list *
6933find_aarch64_elf_section_entry (asection *sec)
6934{
6935 struct section_list *entry;
6936 static struct section_list *last_entry = NULL;
6937
6938 /* This is a short cut for the typical case where the sections are added
6939 to the sections_with_aarch64_elf_section_data list in forward order and
6940 then looked up here in backwards order. This makes a real difference
6941 to the ld-srec/sec64k.exp linker test. */
6942 entry = sections_with_aarch64_elf_section_data;
6943 if (last_entry != NULL)
6944 {
6945 if (last_entry->sec == sec)
6946 entry = last_entry;
6947 else if (last_entry->next != NULL && last_entry->next->sec == sec)
6948 entry = last_entry->next;
6949 }
6950
6951 for (; entry; entry = entry->next)
6952 if (entry->sec == sec)
6953 break;
6954
6955 if (entry)
6956 /* Record the entry prior to this one - it is the entry we are
6957 most likely to want to locate next time. Also this way if we
6958 have been called from
6959 unrecord_section_with_aarch64_elf_section_data () we will not
6960 be caching a pointer that is about to be freed. */
6961 last_entry = entry->prev;
6962
6963 return entry;
6964}
6965
6966static void
6967unrecord_section_with_aarch64_elf_section_data (asection *sec)
6968{
6969 struct section_list *entry;
6970
6971 entry = find_aarch64_elf_section_entry (sec);
6972
6973 if (entry)
6974 {
6975 if (entry->prev != NULL)
6976 entry->prev->next = entry->next;
6977 if (entry->next != NULL)
6978 entry->next->prev = entry->prev;
6979 if (entry == sections_with_aarch64_elf_section_data)
6980 sections_with_aarch64_elf_section_data = entry->next;
6981 free (entry);
6982 }
6983}
6984
6985
6986typedef struct
6987{
6988 void *finfo;
6989 struct bfd_link_info *info;
6990 asection *sec;
6991 int sec_shndx;
6992 int (*func) (void *, const char *, Elf_Internal_Sym *,
6993 asection *, struct elf_link_hash_entry *);
6994} output_arch_syminfo;
6995
6996enum map_symbol_type
6997{
6998 AARCH64_MAP_INSN,
6999 AARCH64_MAP_DATA
7000};
7001
7002
7003/* Output a single mapping symbol. */
7004
7005static bfd_boolean
cec5225b 7006elfNN_aarch64_output_map_sym (output_arch_syminfo *osi,
a06ea964
NC		 7007 enum map_symbol_type type, bfd_vma offset)
7008{
7009 static const char *names[2] = { "$x", "$d" };
7010 Elf_Internal_Sym sym;
7011
7012 sym.st_value = (osi->sec->output_section->vma
7013 + osi->sec->output_offset + offset);
7014 sym.st_size = 0;
7015 sym.st_other = 0;
7016 sym.st_info = ELF_ST_INFO (STB_LOCAL, STT_NOTYPE);
7017 sym.st_shndx = osi->sec_shndx;
7018 return osi->func (osi->finfo, names[type], &sym, osi->sec, NULL) == 1;
7019}
7020
7021
7022
7023/* Output mapping symbols for PLT entries associated with H. */
7024
7025static bfd_boolean
cec5225b 7026elfNN_aarch64_output_plt_map (struct elf_link_hash_entry *h, void *inf)
a06ea964
NC		 7027{
7028 output_arch_syminfo *osi = (output_arch_syminfo *) inf;
7029 bfd_vma addr;
7030
7031 if (h->root.type == bfd_link_hash_indirect)
7032 return TRUE;
7033
7034 if (h->root.type == bfd_link_hash_warning)
7035 /* When warning symbols are created, they **replace** the "real"
7036 entry in the hash table, thus we never get to see the real
7037 symbol in a hash traversal. So look at it now. */
7038 h = (struct elf_link_hash_entry *) h->root.u.i.link;
7039
7040 if (h->plt.offset == (bfd_vma) - 1)
7041 return TRUE;
7042
7043 addr = h->plt.offset;
7044 if (addr == 32)
7045 {
cec5225b 7046 if (!elfNN_aarch64_output_map_sym (osi, AARCH64_MAP_INSN, addr))
a06ea964
NC		 7047 return FALSE;
7048 }
7049 return TRUE;
7050}
7051
7052
7053/* Output a single local symbol for a generated stub. */
7054
7055static bfd_boolean
cec5225b 7056elfNN_aarch64_output_stub_sym (output_arch_syminfo *osi, const char *name,
a06ea964
NC		 7057 bfd_vma offset, bfd_vma size)
7058{
7059 Elf_Internal_Sym sym;
7060
7061 sym.st_value = (osi->sec->output_section->vma
7062 + osi->sec->output_offset + offset);
7063 sym.st_size = size;
7064 sym.st_other = 0;
7065 sym.st_info = ELF_ST_INFO (STB_LOCAL, STT_FUNC);
7066 sym.st_shndx = osi->sec_shndx;
7067 return osi->func (osi->finfo, name, &sym, osi->sec, NULL) == 1;
7068}
7069
7070static bfd_boolean
7071aarch64_map_one_stub (struct bfd_hash_entry *gen_entry, void *in_arg)
7072{
cec5225b 7073 struct elf_aarch64_stub_hash_entry *stub_entry;
a06ea964
NC		 7074 asection *stub_sec;
7075 bfd_vma addr;
7076 char *stub_name;
7077 output_arch_syminfo *osi;
7078
7079 /* Massage our args to the form they really have. */
cec5225b 7080 stub_entry = (struct elf_aarch64_stub_hash_entry *) gen_entry;
a06ea964
NC		 7081 osi = (output_arch_syminfo *) in_arg;
7082
7083 stub_sec = stub_entry->stub_sec;
7084
7085 /* Ensure this stub is attached to the current section being
7086 processed. */
7087 if (stub_sec != osi->sec)
7088 return TRUE;
7089
7090 addr = (bfd_vma) stub_entry->stub_offset;
7091
7092 stub_name = stub_entry->output_name;
7093
7094 switch (stub_entry->stub_type)
7095 {
7096 case aarch64_stub_adrp_branch:
cec5225b 7097 if (!elfNN_aarch64_output_stub_sym (osi, stub_name, addr,
a06ea964
NC		 7098 sizeof (aarch64_adrp_branch_stub)))
7099 return FALSE;
cec5225b 7100 if (!elfNN_aarch64_output_map_sym (osi, AARCH64_MAP_INSN, addr))
a06ea964
NC		 7101 return FALSE;
7102 break;
7103 case aarch64_stub_long_branch:
cec5225b 7104 if (!elfNN_aarch64_output_stub_sym
a06ea964
NC		 7105 (osi, stub_name, addr, sizeof (aarch64_long_branch_stub)))
7106 return FALSE;
cec5225b 7107 if (!elfNN_aarch64_output_map_sym (osi, AARCH64_MAP_INSN, addr))
a06ea964 7108 return FALSE;
cec5225b 7109 if (!elfNN_aarch64_output_map_sym (osi, AARCH64_MAP_DATA, addr + 16))
a06ea964
NC		 7110 return FALSE;
7111 break;
68fcca92
JW		 7112 case aarch64_stub_erratum_835769_veneer:
7113 if (!elfNN_aarch64_output_stub_sym (osi, stub_name, addr,
7114 sizeof (aarch64_erratum_835769_stub)))
7115 return FALSE;
7116 if (!elfNN_aarch64_output_map_sym (osi, AARCH64_MAP_INSN, addr))
7117 return FALSE;
7118 break;
4106101c
MS		 7119 case aarch64_stub_erratum_843419_veneer:
7120 if (!elfNN_aarch64_output_stub_sym (osi, stub_name, addr,
7121 sizeof (aarch64_erratum_843419_stub)))
7122 return FALSE;
7123 if (!elfNN_aarch64_output_map_sym (osi, AARCH64_MAP_INSN, addr))
7124 return FALSE;
7125 break;
7126
a06ea964 7127 default:
8e2fe09f 7128 abort ();
a06ea964
NC		 7129 }
7130
7131 return TRUE;
7132}
7133
7134/* Output mapping symbols for linker generated sections. */
7135
7136static bfd_boolean
cec5225b 7137elfNN_aarch64_output_arch_local_syms (bfd *output_bfd,
a06ea964
NC		 7138 struct bfd_link_info *info,
7139 void *finfo,
7140 int (*func) (void *, const char *,
7141 Elf_Internal_Sym *,
7142 asection *,
7143 struct elf_link_hash_entry
7144 *))
7145{
7146 output_arch_syminfo osi;
cec5225b 7147 struct elf_aarch64_link_hash_table *htab;
a06ea964 7148
cec5225b 7149 htab = elf_aarch64_hash_table (info);
a06ea964
NC		 7150
7151 osi.finfo = finfo;
7152 osi.info = info;
7153 osi.func = func;
7154
7155 /* Long calls stubs. */
7156 if (htab->stub_bfd && htab->stub_bfd->sections)
7157 {
7158 asection *stub_sec;
7159
7160 for (stub_sec = htab->stub_bfd->sections;
7161 stub_sec != NULL; stub_sec = stub_sec->next)
7162 {
7163 /* Ignore non-stub sections. */
7164 if (!strstr (stub_sec->name, STUB_SUFFIX))
7165 continue;
7166
7167 osi.sec = stub_sec;
7168
7169 osi.sec_shndx = _bfd_elf_section_from_bfd_section
7170 (output_bfd, osi.sec->output_section);
7171
61865519
MS		 7172 /* The first instruction in a stub is always a branch. */
7173 if (!elfNN_aarch64_output_map_sym (&osi, AARCH64_MAP_INSN, 0))
7174 return FALSE;
7175
a06ea964
NC		 7176 bfd_hash_traverse (&htab->stub_hash_table, aarch64_map_one_stub,
7177 &osi);
7178 }
7179 }
7180
7181 /* Finally, output mapping symbols for the PLT. */
7182 if (!htab->root.splt || htab->root.splt->size == 0)
7183 return TRUE;
7184
7185 /* For now live without mapping symbols for the plt. */
7186 osi.sec_shndx = _bfd_elf_section_from_bfd_section
7187 (output_bfd, htab->root.splt->output_section);
7188 osi.sec = htab->root.splt;
7189
cec5225b 7190 elf_link_hash_traverse (&htab->root, elfNN_aarch64_output_plt_map,
a06ea964
NC		 7191 (void *) &osi);
7192
7193 return TRUE;
7194
7195}
7196
7197/* Allocate target specific section data. */
7198
7199static bfd_boolean
cec5225b 7200elfNN_aarch64_new_section_hook (bfd *abfd, asection *sec)
a06ea964
NC		 7201{
7202 if (!sec->used_by_bfd)
7203 {
7204 _aarch64_elf_section_data *sdata;
7205 bfd_size_type amt = sizeof (*sdata);
7206
7207 sdata = bfd_zalloc (abfd, amt);
7208 if (sdata == NULL)
7209 return FALSE;
7210 sec->used_by_bfd = sdata;
7211 }
7212
7213 record_section_with_aarch64_elf_section_data (sec);
7214
7215 return _bfd_elf_new_section_hook (abfd, sec);
7216}
7217
7218
7219static void
7220unrecord_section_via_map_over_sections (bfd *abfd ATTRIBUTE_UNUSED,
7221 asection *sec,
7222 void *ignore ATTRIBUTE_UNUSED)
7223{
7224 unrecord_section_with_aarch64_elf_section_data (sec);
7225}
7226
7227static bfd_boolean
cec5225b 7228elfNN_aarch64_close_and_cleanup (bfd *abfd)
a06ea964
NC		 7229{
7230 if (abfd->sections)
7231 bfd_map_over_sections (abfd,
7232 unrecord_section_via_map_over_sections, NULL);
7233
7234 return _bfd_elf_close_and_cleanup (abfd);
7235}
7236
7237static bfd_boolean
cec5225b 7238elfNN_aarch64_bfd_free_cached_info (bfd *abfd)
a06ea964
NC		 7239{
7240 if (abfd->sections)
7241 bfd_map_over_sections (abfd,
7242 unrecord_section_via_map_over_sections, NULL);
7243
7244 return _bfd_free_cached_info (abfd);
7245}
7246
a06ea964
NC		 7247/* Create dynamic sections. This is different from the ARM backend in that
7248 the got, plt, gotplt and their relocation sections are all created in the
7249 standard part of the bfd elf backend. */
7250
7251static bfd_boolean
cec5225b 7252elfNN_aarch64_create_dynamic_sections (bfd *dynobj,
a06ea964
NC		 7253 struct bfd_link_info *info)
7254{
cec5225b 7255 struct elf_aarch64_link_hash_table *htab;
cc0efaa8
MS		 7256
7257 /* We need to create .got section. */
7258 if (!aarch64_elf_create_got_section (dynobj, info))
7259 return FALSE;
a06ea964
NC		 7260
7261 if (!_bfd_elf_create_dynamic_sections (dynobj, info))
7262 return FALSE;
7263
cec5225b 7264 htab = elf_aarch64_hash_table (info);
a06ea964
NC		 7265 htab->sdynbss = bfd_get_linker_section (dynobj, ".dynbss");
7266 if (!info->shared)
7267 htab->srelbss = bfd_get_linker_section (dynobj, ".rela.bss");
7268
7269 if (!htab->sdynbss || (!info->shared && !htab->srelbss))
7270 abort ();
7271
a06ea964
NC		 7272 return TRUE;
7273}
7274
7275
7276/* Allocate space in .plt, .got and associated reloc sections for
7277 dynamic relocs. */
7278
7279static bfd_boolean
cec5225b 7280elfNN_aarch64_allocate_dynrelocs (struct elf_link_hash_entry *h, void *inf)
a06ea964
NC		 7281{
7282 struct bfd_link_info *info;
cec5225b
YZ		 7283 struct elf_aarch64_link_hash_table *htab;
7284 struct elf_aarch64_link_hash_entry *eh;
a06ea964
NC		 7285 struct elf_dyn_relocs *p;
7286
7287 /* An example of a bfd_link_hash_indirect symbol is versioned
7288 symbol. For example: __gxx_personality_v0(bfd_link_hash_indirect)
7289 -> __gxx_personality_v0(bfd_link_hash_defined)
7290
7291 There is no need to process bfd_link_hash_indirect symbols here
7292 because we will also be presented with the concrete instance of
cec5225b 7293 the symbol and elfNN_aarch64_copy_indirect_symbol () will have been
a06ea964
NC		 7294 called to copy all relevant data from the generic to the concrete
7295 symbol instance.
7296 */
7297 if (h->root.type == bfd_link_hash_indirect)
7298 return TRUE;
7299
7300 if (h->root.type == bfd_link_hash_warning)
7301 h = (struct elf_link_hash_entry *) h->root.u.i.link;
7302
7303 info = (struct bfd_link_info *) inf;
cec5225b 7304 htab = elf_aarch64_hash_table (info);
a06ea964 7305
1419bbe5
WN		 7306 /* Since STT_GNU_IFUNC symbol must go through PLT, we handle it
7307 here if it is defined and referenced in a non-shared object. */
7308 if (h->type == STT_GNU_IFUNC
7309 && h->def_regular)
7310 return TRUE;
7311 else if (htab->root.dynamic_sections_created && h->plt.refcount > 0)
a06ea964
NC		 7312 {
7313 /* Make sure this symbol is output as a dynamic symbol.
7314 Undefined weak syms won't yet be marked as dynamic. */
7315 if (h->dynindx == -1 && !h->forced_local)
7316 {
7317 if (!bfd_elf_link_record_dynamic_symbol (info, h))
7318 return FALSE;
7319 }
7320
7321 if (info->shared || WILL_CALL_FINISH_DYNAMIC_SYMBOL (1, 0, h))
7322 {
7323 asection *s = htab->root.splt;
7324
7325 /* If this is the first .plt entry, make room for the special
7326 first entry. */
7327 if (s->size == 0)
7328 s->size += htab->plt_header_size;
7329
7330 h->plt.offset = s->size;
7331
7332 /* If this symbol is not defined in a regular file, and we are
7333 not generating a shared library, then set the symbol to this
7334 location in the .plt. This is required to make function
7335 pointers compare as equal between the normal executable and
7336 the shared library. */
7337 if (!info->shared && !h->def_regular)
7338 {
7339 h->root.u.def.section = s;
7340 h->root.u.def.value = h->plt.offset;
7341 }
7342
7343 /* Make room for this entry. For now we only create the
7344 small model PLT entries. We later need to find a way
7345 of relaxing into these from the large model PLT entries. */
7346 s->size += PLT_SMALL_ENTRY_SIZE;
7347
7348 /* We also need to make an entry in the .got.plt section, which
7349 will be placed in the .got section by the linker script. */
7350 htab->root.sgotplt->size += GOT_ENTRY_SIZE;
7351
7352 /* We also need to make an entry in the .rela.plt section. */
7353 htab->root.srelplt->size += RELOC_SIZE (htab);
7354
7355 /* We need to ensure that all GOT entries that serve the PLT
7356 are consecutive with the special GOT slots [0] [1] and
7357 [2]. Any addtional relocations, such as
7358 R_AARCH64_TLSDESC, must be placed after the PLT related
7359 entries. We abuse the reloc_count such that during
7360 sizing we adjust reloc_count to indicate the number of
7361 PLT related reserved entries. In subsequent phases when
7362 filling in the contents of the reloc entries, PLT related
7363 entries are placed by computing their PLT index (0
7364 .. reloc_count). While other none PLT relocs are placed
7365 at the slot indicated by reloc_count and reloc_count is
7366 updated. */
7367
7368 htab->root.srelplt->reloc_count++;
7369 }
7370 else
7371 {
7372 h->plt.offset = (bfd_vma) - 1;
7373 h->needs_plt = 0;
7374 }
7375 }
7376 else
7377 {
7378 h->plt.offset = (bfd_vma) - 1;
7379 h->needs_plt = 0;
7380 }
7381
cec5225b 7382 eh = (struct elf_aarch64_link_hash_entry *) h;
a06ea964
NC		 7383 eh->tlsdesc_got_jump_table_offset = (bfd_vma) - 1;
7384
7385 if (h->got.refcount > 0)
7386 {
7387 bfd_boolean dyn;
cec5225b 7388 unsigned got_type = elf_aarch64_hash_entry (h)->got_type;
a06ea964
NC		 7389
7390 h->got.offset = (bfd_vma) - 1;
7391
7392 dyn = htab->root.dynamic_sections_created;
7393
7394 /* Make sure this symbol is output as a dynamic symbol.
7395 Undefined weak syms won't yet be marked as dynamic. */
7396 if (dyn && h->dynindx == -1 && !h->forced_local)
7397 {
7398 if (!bfd_elf_link_record_dynamic_symbol (info, h))
7399 return FALSE;
7400 }
7401
7402 if (got_type == GOT_UNKNOWN)
7403 {
7404 }
7405 else if (got_type == GOT_NORMAL)
7406 {
7407 h->got.offset = htab->root.sgot->size;
7408 htab->root.sgot->size += GOT_ENTRY_SIZE;
7409 if ((ELF_ST_VISIBILITY (h->other) == STV_DEFAULT
7410 || h->root.type != bfd_link_hash_undefweak)
7411 && (info->shared
7412 || WILL_CALL_FINISH_DYNAMIC_SYMBOL (dyn, 0, h)))
7413 {
7414 htab->root.srelgot->size += RELOC_SIZE (htab);
7415 }
7416 }
7417 else
7418 {
7419 int indx;
7420 if (got_type & GOT_TLSDESC_GD)
7421 {
7422 eh->tlsdesc_got_jump_table_offset =
7423 (htab->root.sgotplt->size
7424 - aarch64_compute_jump_table_size (htab));
7425 htab->root.sgotplt->size += GOT_ENTRY_SIZE * 2;
7426 h->got.offset = (bfd_vma) - 2;
7427 }
7428
7429 if (got_type & GOT_TLS_GD)
7430 {
7431 h->got.offset = htab->root.sgot->size;
7432 htab->root.sgot->size += GOT_ENTRY_SIZE * 2;
7433 }
7434
7435 if (got_type & GOT_TLS_IE)
7436 {
7437 h->got.offset = htab->root.sgot->size;
7438 htab->root.sgot->size += GOT_ENTRY_SIZE;
7439 }
7440
7441 indx = h && h->dynindx != -1 ? h->dynindx : 0;
7442 if ((ELF_ST_VISIBILITY (h->other) == STV_DEFAULT
7443 || h->root.type != bfd_link_hash_undefweak)
7444 && (info->shared
7445 || indx != 0
7446 || WILL_CALL_FINISH_DYNAMIC_SYMBOL (dyn, 0, h)))
7447 {
7448 if (got_type & GOT_TLSDESC_GD)
7449 {
7450 htab->root.srelplt->size += RELOC_SIZE (htab);
7451 /* Note reloc_count not incremented here! We have
7452 already adjusted reloc_count for this relocation
7453 type. */
7454
7455 /* TLSDESC PLT is now needed, but not yet determined. */
7456 htab->tlsdesc_plt = (bfd_vma) - 1;
7457 }
7458
7459 if (got_type & GOT_TLS_GD)
7460 htab->root.srelgot->size += RELOC_SIZE (htab) * 2;
7461
7462 if (got_type & GOT_TLS_IE)
7463 htab->root.srelgot->size += RELOC_SIZE (htab);
7464 }
7465 }
7466 }
7467 else
7468 {
7469 h->got.offset = (bfd_vma) - 1;
7470 }
7471
7472 if (eh->dyn_relocs == NULL)
7473 return TRUE;
7474
7475 /* In the shared -Bsymbolic case, discard space allocated for
7476 dynamic pc-relative relocs against symbols which turn out to be
7477 defined in regular objects. For the normal shared case, discard
7478 space for pc-relative relocs that have become local due to symbol
7479 visibility changes. */
7480
7481 if (info->shared)
7482 {
7483 /* Relocs that use pc_count are those that appear on a call
7484 insn, or certain REL relocs that can generated via assembly.
7485 We want calls to protected symbols to resolve directly to the
7486 function rather than going via the plt. If people want
7487 function pointer comparisons to work as expected then they
7488 should avoid writing weird assembly. */
7489 if (SYMBOL_CALLS_LOCAL (info, h))
7490 {
7491 struct elf_dyn_relocs **pp;
7492
7493 for (pp = &eh->dyn_relocs; (p = *pp) != NULL;)
7494 {
7495 p->count -= p->pc_count;
7496 p->pc_count = 0;
7497 if (p->count == 0)
7498 *pp = p->next;
7499 else
7500 pp = &p->next;
7501 }
7502 }
7503
7504 /* Also discard relocs on undefined weak syms with non-default
7505 visibility. */
7506 if (eh->dyn_relocs != NULL && h->root.type == bfd_link_hash_undefweak)
7507 {
7508 if (ELF_ST_VISIBILITY (h->other) != STV_DEFAULT)
7509 eh->dyn_relocs = NULL;
7510
7511 /* Make sure undefined weak symbols are output as a dynamic
7512 symbol in PIEs. */
7513 else if (h->dynindx == -1
7514 && !h->forced_local
7515 && !bfd_elf_link_record_dynamic_symbol (info, h))
7516 return FALSE;
7517 }
7518
7519 }
7520 else if (ELIMINATE_COPY_RELOCS)
7521 {
7522 /* For the non-shared case, discard space for relocs against
7523 symbols which turn out to need copy relocs or are not
7524 dynamic. */
7525
7526 if (!h->non_got_ref
7527 && ((h->def_dynamic
7528 && !h->def_regular)
7529 || (htab->root.dynamic_sections_created
7530 && (h->root.type == bfd_link_hash_undefweak
7531 || h->root.type == bfd_link_hash_undefined))))
7532 {
7533 /* Make sure this symbol is output as a dynamic symbol.
7534 Undefined weak syms won't yet be marked as dynamic. */
7535 if (h->dynindx == -1
7536 && !h->forced_local
7537 && !bfd_elf_link_record_dynamic_symbol (info, h))
7538 return FALSE;
7539
7540 /* If that succeeded, we know we'll be keeping all the
7541 relocs. */
7542 if (h->dynindx != -1)
7543 goto keep;
7544 }
7545
7546 eh->dyn_relocs = NULL;
7547
7548 keep:;
7549 }
7550
7551 /* Finally, allocate space. */
7552 for (p = eh->dyn_relocs; p != NULL; p = p->next)
7553 {
7554 asection *sreloc;
7555
7556 sreloc = elf_section_data (p->sec)->sreloc;
7557
7558 BFD_ASSERT (sreloc != NULL);
7559
7560 sreloc->size += p->count * RELOC_SIZE (htab);
7561 }
7562
7563 return TRUE;
7564}
7565
1419bbe5
WN		 7566/* Allocate space in .plt, .got and associated reloc sections for
7567 ifunc dynamic relocs. */
7568
7569static bfd_boolean
7570elfNN_aarch64_allocate_ifunc_dynrelocs (struct elf_link_hash_entry *h,
7571 void *inf)
7572{
7573 struct bfd_link_info *info;
7574 struct elf_aarch64_link_hash_table *htab;
7575 struct elf_aarch64_link_hash_entry *eh;
7576
7577 /* An example of a bfd_link_hash_indirect symbol is versioned
7578 symbol. For example: __gxx_personality_v0(bfd_link_hash_indirect)
7579 -> __gxx_personality_v0(bfd_link_hash_defined)
7580
7581 There is no need to process bfd_link_hash_indirect symbols here
7582 because we will also be presented with the concrete instance of
7583 the symbol and elfNN_aarch64_copy_indirect_symbol () will have been
7584 called to copy all relevant data from the generic to the concrete
7585 symbol instance.
7586 */
7587 if (h->root.type == bfd_link_hash_indirect)
7588 return TRUE;
7589
7590 if (h->root.type == bfd_link_hash_warning)
7591 h = (struct elf_link_hash_entry *) h->root.u.i.link;
7592
7593 info = (struct bfd_link_info *) inf;
7594 htab = elf_aarch64_hash_table (info);
7595
7596 eh = (struct elf_aarch64_link_hash_entry *) h;
7597
7598 /* Since STT_GNU_IFUNC symbol must go through PLT, we handle it
7599 here if it is defined and referenced in a non-shared object. */
7600 if (h->type == STT_GNU_IFUNC
7601 && h->def_regular)
7602 return _bfd_elf_allocate_ifunc_dyn_relocs (info, h,
7603 &eh->dyn_relocs,
7604 htab->plt_entry_size,
7605 htab->plt_header_size,
7606 GOT_ENTRY_SIZE);
7607 return TRUE;
7608}
7609
7610/* Allocate space in .plt, .got and associated reloc sections for
7611 local dynamic relocs. */
7612
7613static bfd_boolean
7614elfNN_aarch64_allocate_local_dynrelocs (void **slot, void *inf)
7615{
7616 struct elf_link_hash_entry *h
7617 = (struct elf_link_hash_entry *) *slot;
7618
7619 if (h->type != STT_GNU_IFUNC
7620 || !h->def_regular
7621 || !h->ref_regular
7622 || !h->forced_local
7623 || h->root.type != bfd_link_hash_defined)
7624 abort ();
7625
7626 return elfNN_aarch64_allocate_dynrelocs (h, inf);
7627}
7628
7629/* Allocate space in .plt, .got and associated reloc sections for
7630 local ifunc dynamic relocs. */
7631
7632static bfd_boolean
7633elfNN_aarch64_allocate_local_ifunc_dynrelocs (void **slot, void *inf)
7634{
7635 struct elf_link_hash_entry *h
7636 = (struct elf_link_hash_entry *) *slot;
7637
7638 if (h->type != STT_GNU_IFUNC
7639 || !h->def_regular
7640 || !h->ref_regular
7641 || !h->forced_local
7642 || h->root.type != bfd_link_hash_defined)
7643 abort ();
7644
7645 return elfNN_aarch64_allocate_ifunc_dynrelocs (h, inf);
7646}
a06ea964 7647
c2170589
JW		 7648/* Find any dynamic relocs that apply to read-only sections. */
7649
7650static bfd_boolean
7651aarch64_readonly_dynrelocs (struct elf_link_hash_entry * h, void * inf)
7652{
7653 struct elf_aarch64_link_hash_entry * eh;
7654 struct elf_dyn_relocs * p;
7655
7656 eh = (struct elf_aarch64_link_hash_entry *) h;
7657 for (p = eh->dyn_relocs; p != NULL; p = p->next)
7658 {
7659 asection *s = p->sec;
7660
7661 if (s != NULL && (s->flags & SEC_READONLY) != 0)
7662 {
7663 struct bfd_link_info *info = (struct bfd_link_info *) inf;
7664
7665 info->flags |= DF_TEXTREL;
7666
7667 /* Not an error, just cut short the traversal. */
7668 return FALSE;
7669 }
7670 }
7671 return TRUE;
7672}
7673
a06ea964
NC		 7674/* This is the most important function of all . Innocuosly named
7675 though ! */
7676static bfd_boolean
cec5225b 7677elfNN_aarch64_size_dynamic_sections (bfd *output_bfd ATTRIBUTE_UNUSED,
a06ea964
NC		 7678 struct bfd_link_info *info)
7679{
cec5225b 7680 struct elf_aarch64_link_hash_table *htab;
a06ea964
NC		 7681 bfd *dynobj;
7682 asection *s;
7683 bfd_boolean relocs;
7684 bfd *ibfd;
7685
cec5225b 7686 htab = elf_aarch64_hash_table ((info));
a06ea964
NC		 7687 dynobj = htab->root.dynobj;
7688
7689 BFD_ASSERT (dynobj != NULL);
7690
7691 if (htab->root.dynamic_sections_created)
7692 {
7693 if (info->executable)
7694 {
7695 s = bfd_get_linker_section (dynobj, ".interp");
7696 if (s == NULL)
7697 abort ();
7698 s->size = sizeof ELF_DYNAMIC_INTERPRETER;
7699 s->contents = (unsigned char *) ELF_DYNAMIC_INTERPRETER;
7700 }
7701 }
7702
7703 /* Set up .got offsets for local syms, and space for local dynamic
7704 relocs. */
c72f2fb2 7705 for (ibfd = info->input_bfds; ibfd != NULL; ibfd = ibfd->link.next)
a06ea964
NC		 7706 {
7707 struct elf_aarch64_local_symbol *locals = NULL;
7708 Elf_Internal_Shdr *symtab_hdr;
7709 asection *srel;
7710 unsigned int i;
7711
7712 if (!is_aarch64_elf (ibfd))
7713 continue;
7714
7715 for (s = ibfd->sections; s != NULL; s = s->next)
7716 {
7717 struct elf_dyn_relocs *p;
7718
7719 for (p = (struct elf_dyn_relocs *)
7720 (elf_section_data (s)->local_dynrel); p != NULL; p = p->next)
7721 {
7722 if (!bfd_is_abs_section (p->sec)
7723 && bfd_is_abs_section (p->sec->output_section))
7724 {
7725 /* Input section has been discarded, either because
7726 it is a copy of a linkonce section or due to
7727 linker script /DISCARD/, so we'll be discarding
7728 the relocs too. */
7729 }
7730 else if (p->count != 0)
7731 {
7732 srel = elf_section_data (p->sec)->sreloc;
7733 srel->size += p->count * RELOC_SIZE (htab);
7734 if ((p->sec->output_section->flags & SEC_READONLY) != 0)
7735 info->flags |= DF_TEXTREL;
7736 }
7737 }
7738 }
7739
cec5225b 7740 locals = elf_aarch64_locals (ibfd);
a06ea964
NC		 7741 if (!locals)
7742 continue;
7743
7744 symtab_hdr = &elf_symtab_hdr (ibfd);
7745 srel = htab->root.srelgot;
7746 for (i = 0; i < symtab_hdr->sh_info; i++)
7747 {
7748 locals[i].got_offset = (bfd_vma) - 1;
7749 locals[i].tlsdesc_got_jump_table_offset = (bfd_vma) - 1;
7750 if (locals[i].got_refcount > 0)
7751 {
7752 unsigned got_type = locals[i].got_type;
7753 if (got_type & GOT_TLSDESC_GD)
7754 {
7755 locals[i].tlsdesc_got_jump_table_offset =
7756 (htab->root.sgotplt->size
7757 - aarch64_compute_jump_table_size (htab));
7758 htab->root.sgotplt->size += GOT_ENTRY_SIZE * 2;
7759 locals[i].got_offset = (bfd_vma) - 2;
7760 }
7761
7762 if (got_type & GOT_TLS_GD)
7763 {
7764 locals[i].got_offset = htab->root.sgot->size;
7765 htab->root.sgot->size += GOT_ENTRY_SIZE * 2;
7766 }
7767
b53b1bed
JW		 7768 if (got_type & GOT_TLS_IE
7769 || got_type & GOT_NORMAL)
a06ea964
NC		 7770 {
7771 locals[i].got_offset = htab->root.sgot->size;
7772 htab->root.sgot->size += GOT_ENTRY_SIZE;
7773 }
7774
7775 if (got_type == GOT_UNKNOWN)
7776 {
7777 }
7778
a06ea964
NC		 7779 if (info->shared)
7780 {
7781 if (got_type & GOT_TLSDESC_GD)
7782 {
7783 htab->root.srelplt->size += RELOC_SIZE (htab);
7784 /* Note RELOC_COUNT not incremented here! */
7785 htab->tlsdesc_plt = (bfd_vma) - 1;
7786 }
7787
7788 if (got_type & GOT_TLS_GD)
7789 htab->root.srelgot->size += RELOC_SIZE (htab) * 2;
7790
b53b1bed
JW		 7791 if (got_type & GOT_TLS_IE
7792 || got_type & GOT_NORMAL)
a06ea964
NC		 7793 htab->root.srelgot->size += RELOC_SIZE (htab);
7794 }
7795 }
7796 else
7797 {
7798 locals[i].got_refcount = (bfd_vma) - 1;
7799 }
7800 }
7801 }
7802
7803
7804 /* Allocate global sym .plt and .got entries, and space for global
7805 sym dynamic relocs. */
cec5225b 7806 elf_link_hash_traverse (&htab->root, elfNN_aarch64_allocate_dynrelocs,
a06ea964
NC		 7807 info);
7808
1419bbe5
WN		 7809 /* Allocate global ifunc sym .plt and .got entries, and space for global
7810 ifunc sym dynamic relocs. */
7811 elf_link_hash_traverse (&htab->root, elfNN_aarch64_allocate_ifunc_dynrelocs,
7812 info);
7813
7814 /* Allocate .plt and .got entries, and space for local symbols. */
7815 htab_traverse (htab->loc_hash_table,
7816 elfNN_aarch64_allocate_local_dynrelocs,
7817 info);
7818
7819 /* Allocate .plt and .got entries, and space for local ifunc symbols. */
7820 htab_traverse (htab->loc_hash_table,
7821 elfNN_aarch64_allocate_local_ifunc_dynrelocs,
7822 info);
a06ea964
NC		 7823
7824 /* For every jump slot reserved in the sgotplt, reloc_count is
7825 incremented. However, when we reserve space for TLS descriptors,
7826 it's not incremented, so in order to compute the space reserved
7827 for them, it suffices to multiply the reloc count by the jump
7828 slot size. */
7829
7830 if (htab->root.srelplt)
8847944f 7831 htab->sgotplt_jump_table_size = aarch64_compute_jump_table_size (htab);
a06ea964
NC		 7832
7833 if (htab->tlsdesc_plt)
7834 {
7835 if (htab->root.splt->size == 0)
7836 htab->root.splt->size += PLT_ENTRY_SIZE;
7837
7838 htab->tlsdesc_plt = htab->root.splt->size;
7839 htab->root.splt->size += PLT_TLSDESC_ENTRY_SIZE;
7840
7841 /* If we're not using lazy TLS relocations, don't generate the
7842 GOT entry required. */
7843 if (!(info->flags & DF_BIND_NOW))
7844 {
7845 htab->dt_tlsdesc_got = htab->root.sgot->size;
7846 htab->root.sgot->size += GOT_ENTRY_SIZE;
7847 }
7848 }
7849
68fcca92 7850 /* Init mapping symbols information to use later to distingush between
4106101c
MS		 7851 code and data while scanning for errata. */
7852 if (htab->fix_erratum_835769 || htab->fix_erratum_843419)
68fcca92
JW		 7853 for (ibfd = info->input_bfds; ibfd != NULL; ibfd = ibfd->link.next)
7854 {
7855 if (!is_aarch64_elf (ibfd))
7856 continue;
7857 bfd_elfNN_aarch64_init_maps (ibfd);
7858 }
7859
a06ea964
NC		 7860 /* We now have determined the sizes of the various dynamic sections.
7861 Allocate memory for them. */
7862 relocs = FALSE;
7863 for (s = dynobj->sections; s != NULL; s = s->next)
7864 {
7865 if ((s->flags & SEC_LINKER_CREATED) == 0)
7866 continue;
7867
7868 if (s == htab->root.splt
7869 || s == htab->root.sgot
7870 || s == htab->root.sgotplt
7871 || s == htab->root.iplt
7872 || s == htab->root.igotplt || s == htab->sdynbss)
7873 {
7874 /* Strip this section if we don't need it; see the
7875 comment below. */
7876 }
7877 else if (CONST_STRNEQ (bfd_get_section_name (dynobj, s), ".rela"))
7878 {
7879 if (s->size != 0 && s != htab->root.srelplt)
7880 relocs = TRUE;
7881
7882 /* We use the reloc_count field as a counter if we need
7883 to copy relocs into the output file. */
7884 if (s != htab->root.srelplt)
7885 s->reloc_count = 0;
7886 }
7887 else
7888 {
7889 /* It's not one of our sections, so don't allocate space. */
7890 continue;
7891 }
7892
7893 if (s->size == 0)
7894 {
7895 /* If we don't need this section, strip it from the
7896 output file. This is mostly to handle .rela.bss and
7897 .rela.plt. We must create both sections in
7898 create_dynamic_sections, because they must be created
7899 before the linker maps input sections to output
7900 sections. The linker does that before
7901 adjust_dynamic_symbol is called, and it is that
7902 function which decides whether anything needs to go
7903 into these sections. */
7904
7905 s->flags |= SEC_EXCLUDE;
7906 continue;
7907 }
7908
7909 if ((s->flags & SEC_HAS_CONTENTS) == 0)
7910 continue;
7911
7912 /* Allocate memory for the section contents. We use bfd_zalloc
7913 here in case unused entries are not reclaimed before the
7914 section's contents are written out. This should not happen,
7915 but this way if it does, we get a R_AARCH64_NONE reloc instead
7916 of garbage. */
7917 s->contents = (bfd_byte *) bfd_zalloc (dynobj, s->size);
7918 if (s->contents == NULL)
7919 return FALSE;
7920 }
7921
7922 if (htab->root.dynamic_sections_created)
7923 {
7924 /* Add some entries to the .dynamic section. We fill in the
cec5225b 7925 values later, in elfNN_aarch64_finish_dynamic_sections, but we
a06ea964
NC		 7926 must add the entries now so that we get the correct size for
7927 the .dynamic section. The DT_DEBUG entry is filled in by the
7928 dynamic linker and used by the debugger. */
7929#define add_dynamic_entry(TAG, VAL) \
7930 _bfd_elf_add_dynamic_entry (info, TAG, VAL)
7931
7932 if (info->executable)
7933 {
7934 if (!add_dynamic_entry (DT_DEBUG, 0))
7935 return FALSE;
7936 }
7937
7938 if (htab->root.splt->size != 0)
7939 {
7940 if (!add_dynamic_entry (DT_PLTGOT, 0)
7941 || !add_dynamic_entry (DT_PLTRELSZ, 0)
7942 || !add_dynamic_entry (DT_PLTREL, DT_RELA)
7943 || !add_dynamic_entry (DT_JMPREL, 0))
7944 return FALSE;
7945
7946 if (htab->tlsdesc_plt
7947 && (!add_dynamic_entry (DT_TLSDESC_PLT, 0)
7948 || !add_dynamic_entry (DT_TLSDESC_GOT, 0)))
7949 return FALSE;
7950 }
7951
7952 if (relocs)
7953 {
7954 if (!add_dynamic_entry (DT_RELA, 0)
7955 || !add_dynamic_entry (DT_RELASZ, 0)
7956 || !add_dynamic_entry (DT_RELAENT, RELOC_SIZE (htab)))
7957 return FALSE;
7958
7959 /* If any dynamic relocs apply to a read-only section,
7960 then we need a DT_TEXTREL entry. */
c2170589
JW		 7961 if ((info->flags & DF_TEXTREL) == 0)
7962 elf_link_hash_traverse (& htab->root, aarch64_readonly_dynrelocs,
7963 info);
7964
a06ea964
NC		 7965 if ((info->flags & DF_TEXTREL) != 0)
7966 {
7967 if (!add_dynamic_entry (DT_TEXTREL, 0))
7968 return FALSE;
7969 }
7970 }
7971 }
7972#undef add_dynamic_entry
7973
7974 return TRUE;
a06ea964
NC		 7975}
7976
7977static inline void
caed7120
YZ		 7978elf_aarch64_update_plt_entry (bfd *output_bfd,
7979 bfd_reloc_code_real_type r_type,
7980 bfd_byte *plt_entry, bfd_vma value)
a06ea964 7981{
caed7120
YZ		 7982 reloc_howto_type *howto = elfNN_aarch64_howto_from_bfd_reloc (r_type);
7983
7984 _bfd_aarch64_elf_put_addend (output_bfd, plt_entry, r_type, howto, value);
a06ea964
NC		 7985}
7986
7987static void
cec5225b
YZ		 7988elfNN_aarch64_create_small_pltn_entry (struct elf_link_hash_entry *h,
7989 struct elf_aarch64_link_hash_table
1419bbe5
WN		 7990 *htab, bfd *output_bfd,
7991 struct bfd_link_info *info)
a06ea964
NC		 7992{
7993 bfd_byte *plt_entry;
7994 bfd_vma plt_index;
7995 bfd_vma got_offset;
7996 bfd_vma gotplt_entry_address;
7997 bfd_vma plt_entry_address;
7998 Elf_Internal_Rela rela;
7999 bfd_byte *loc;
1419bbe5
WN		 8000 asection *plt, *gotplt, *relplt;
8001
8002 /* When building a static executable, use .iplt, .igot.plt and
8003 .rela.iplt sections for STT_GNU_IFUNC symbols. */
8004 if (htab->root.splt != NULL)
8005 {
8006 plt = htab->root.splt;
8007 gotplt = htab->root.sgotplt;
8008 relplt = htab->root.srelplt;
8009 }
8010 else
8011 {
8012 plt = htab->root.iplt;
8013 gotplt = htab->root.igotplt;
8014 relplt = htab->root.irelplt;
8015 }
8016
8017 /* Get the index in the procedure linkage table which
8018 corresponds to this symbol. This is the index of this symbol
8019 in all the symbols for which we are making plt entries. The
8020 first entry in the procedure linkage table is reserved.
a06ea964 8021
1419bbe5
WN		 8022 Get the offset into the .got table of the entry that
8023 corresponds to this function. Each .got entry is GOT_ENTRY_SIZE
8024 bytes. The first three are reserved for the dynamic linker.
692e2b8b 8025
1419bbe5
WN		 8026 For static executables, we don't reserve anything. */
8027
8028 if (plt == htab->root.splt)
8029 {
8030 plt_index = (h->plt.offset - htab->plt_header_size) / htab->plt_entry_size;
8031 got_offset = (plt_index + 3) * GOT_ENTRY_SIZE;
8032 }
8033 else
8034 {
8035 plt_index = h->plt.offset / htab->plt_entry_size;
8036 got_offset = plt_index * GOT_ENTRY_SIZE;
8037 }
8038
8039 plt_entry = plt->contents + h->plt.offset;
8040 plt_entry_address = plt->output_section->vma
f44a1f8e 8041 + plt->output_offset + h->plt.offset;
1419bbe5
WN		 8042 gotplt_entry_address = gotplt->output_section->vma +
8043 gotplt->output_offset + got_offset;
a06ea964
NC		 8044
8045 /* Copy in the boiler-plate for the PLTn entry. */
cec5225b 8046 memcpy (plt_entry, elfNN_aarch64_small_plt_entry, PLT_SMALL_ENTRY_SIZE);
a06ea964
NC		 8047
8048 /* Fill in the top 21 bits for this: ADRP x16, PLT_GOT + n * 8.
8049 ADRP: ((PG(S+A)-PG(P)) >> 12) & 0x1fffff */
caed7120
YZ		 8050 elf_aarch64_update_plt_entry (output_bfd, BFD_RELOC_AARCH64_ADR_HI21_PCREL,
8051 plt_entry,
8052 PG (gotplt_entry_address) -
8053 PG (plt_entry_address));
a06ea964
NC		 8054
8055 /* Fill in the lo12 bits for the load from the pltgot. */
caed7120
YZ		 8056 elf_aarch64_update_plt_entry (output_bfd, BFD_RELOC_AARCH64_LDSTNN_LO12,
8057 plt_entry + 4,
8058 PG_OFFSET (gotplt_entry_address));
a06ea964 8059
9aff4b7a 8060 /* Fill in the lo12 bits for the add from the pltgot entry. */
caed7120
YZ		 8061 elf_aarch64_update_plt_entry (output_bfd, BFD_RELOC_AARCH64_ADD_LO12,
8062 plt_entry + 8,
8063 PG_OFFSET (gotplt_entry_address));
a06ea964
NC		 8064
8065 /* All the GOTPLT Entries are essentially initialized to PLT0. */
cec5225b 8066 bfd_put_NN (output_bfd,
1419bbe5
WN		 8067 plt->output_section->vma + plt->output_offset,
8068 gotplt->contents + got_offset);
a06ea964 8069
a06ea964 8070 rela.r_offset = gotplt_entry_address;
1419bbe5
WN		 8071
8072 if (h->dynindx == -1
8073 || ((info->executable
8074 || ELF_ST_VISIBILITY (h->other) != STV_DEFAULT)
8075 && h->def_regular
8076 && h->type == STT_GNU_IFUNC))
8077 {
8078 /* If an STT_GNU_IFUNC symbol is locally defined, generate
8079 R_AARCH64_IRELATIVE instead of R_AARCH64_JUMP_SLOT. */
8080 rela.r_info = ELFNN_R_INFO (0, AARCH64_R (IRELATIVE));
8081 rela.r_addend = (h->root.u.def.value
8082 + h->root.u.def.section->output_section->vma
8083 + h->root.u.def.section->output_offset);
8084 }
8085 else
8086 {
8087 /* Fill in the entry in the .rela.plt section. */
8088 rela.r_info = ELFNN_R_INFO (h->dynindx, AARCH64_R (JUMP_SLOT));
8089 rela.r_addend = 0;
8090 }
a06ea964
NC		 8091
8092 /* Compute the relocation entry to used based on PLT index and do
8093 not adjust reloc_count. The reloc_count has already been adjusted
8094 to account for this entry. */
1419bbe5 8095 loc = relplt->contents + plt_index * RELOC_SIZE (htab);
cec5225b 8096 bfd_elfNN_swap_reloca_out (output_bfd, &rela, loc);
a06ea964
NC		 8097}
8098
8099/* Size sections even though they're not dynamic. We use it to setup
8100 _TLS_MODULE_BASE_, if needed. */
8101
8102static bfd_boolean
cec5225b 8103elfNN_aarch64_always_size_sections (bfd *output_bfd,
a06ea964
NC		 8104 struct bfd_link_info *info)
8105{
8106 asection *tls_sec;
8107
8108 if (info->relocatable)
8109 return TRUE;
8110
8111 tls_sec = elf_hash_table (info)->tls_sec;
8112
8113 if (tls_sec)
8114 {
8115 struct elf_link_hash_entry *tlsbase;
8116
8117 tlsbase = elf_link_hash_lookup (elf_hash_table (info),
8118 "_TLS_MODULE_BASE_", TRUE, TRUE, FALSE);
8119
8120 if (tlsbase)
8121 {
8122 struct bfd_link_hash_entry *h = NULL;
8123 const struct elf_backend_data *bed =
8124 get_elf_backend_data (output_bfd);
8125
8126 if (!(_bfd_generic_link_add_one_symbol
8127 (info, output_bfd, "_TLS_MODULE_BASE_", BSF_LOCAL,
8128 tls_sec, 0, NULL, FALSE, bed->collect, &h)))
8129 return FALSE;
8130
8131 tlsbase->type = STT_TLS;
8132 tlsbase = (struct elf_link_hash_entry *) h;
8133 tlsbase->def_regular = 1;
8134 tlsbase->other = STV_HIDDEN;
8135 (*bed->elf_backend_hide_symbol) (info, tlsbase, TRUE);
8136 }
8137 }
8138
8139 return TRUE;
8140}
8141
8142/* Finish up dynamic symbol handling. We set the contents of various
8143 dynamic sections here. */
8144static bfd_boolean
cec5225b 8145elfNN_aarch64_finish_dynamic_symbol (bfd *output_bfd,
a06ea964
NC		 8146 struct bfd_link_info *info,
8147 struct elf_link_hash_entry *h,
8148 Elf_Internal_Sym *sym)
8149{
cec5225b
YZ		 8150 struct elf_aarch64_link_hash_table *htab;
8151 htab = elf_aarch64_hash_table (info);
a06ea964
NC		 8152
8153 if (h->plt.offset != (bfd_vma) - 1)
8154 {
1419bbe5
WN		 8155 asection *plt, *gotplt, *relplt;
8156
a06ea964
NC		 8157 /* This symbol has an entry in the procedure linkage table. Set
8158 it up. */
8159
1419bbe5
WN		 8160 /* When building a static executable, use .iplt, .igot.plt and
8161 .rela.iplt sections for STT_GNU_IFUNC symbols. */
8162 if (htab->root.splt != NULL)
8163 {
8164 plt = htab->root.splt;
8165 gotplt = htab->root.sgotplt;
8166 relplt = htab->root.srelplt;
8167 }
8168 else
8169 {
8170 plt = htab->root.iplt;
8171 gotplt = htab->root.igotplt;
8172 relplt = htab->root.irelplt;
8173 }
8174
8175 /* This symbol has an entry in the procedure linkage table. Set
8176 it up. */
8177 if ((h->dynindx == -1
8178 && !((h->forced_local || info->executable)
8179 && h->def_regular
8180 && h->type == STT_GNU_IFUNC))
8181 || plt == NULL
8182 || gotplt == NULL
8183 || relplt == NULL)
a06ea964
NC		 8184 abort ();
8185
1419bbe5 8186 elfNN_aarch64_create_small_pltn_entry (h, htab, output_bfd, info);
a06ea964
NC		 8187 if (!h->def_regular)
8188 {
8189 /* Mark the symbol as undefined, rather than as defined in
46b87d49 8190 the .plt section. */
a06ea964 8191 sym->st_shndx = SHN_UNDEF;
46b87d49
WN		 8192 /* If the symbol is weak we need to clear the value.
8193 Otherwise, the PLT entry would provide a definition for
8194 the symbol even if the symbol wasn't defined anywhere,
8195 and so the symbol would never be NULL. Leave the value if
8196 there were any relocations where pointer equality matters
8197 (this is a clue for the dynamic linker, to make function
8198 pointer comparisons work between an application and shared
8199 library). */
8200 if (!h->ref_regular_nonweak || !h->pointer_equality_needed)
8201 sym->st_value = 0;
a06ea964
NC		 8202 }
8203 }
8204
8205 if (h->got.offset != (bfd_vma) - 1
cec5225b 8206 && elf_aarch64_hash_entry (h)->got_type == GOT_NORMAL)
a06ea964
NC		 8207 {
8208 Elf_Internal_Rela rela;
8209 bfd_byte *loc;
8210
8211 /* This symbol has an entry in the global offset table. Set it
8212 up. */
8213 if (htab->root.sgot == NULL || htab->root.srelgot == NULL)
8214 abort ();
8215
8216 rela.r_offset = (htab->root.sgot->output_section->vma
8217 + htab->root.sgot->output_offset
8218 + (h->got.offset & ~(bfd_vma) 1));
8219
49206388
WN		 8220 if (h->def_regular
8221 && h->type == STT_GNU_IFUNC)
8222 {
8223 if (info->shared)
8224 {
8225 /* Generate R_AARCH64_GLOB_DAT. */
8226 goto do_glob_dat;
8227 }
8228 else
8229 {
8230 asection *plt;
8231
8232 if (!h->pointer_equality_needed)
8233 abort ();
8234
8235 /* For non-shared object, we can't use .got.plt, which
8236 contains the real function address if we need pointer
8237 equality. We load the GOT entry with the PLT entry. */
8238 plt = htab->root.splt ? htab->root.splt : htab->root.iplt;
8239 bfd_put_NN (output_bfd, (plt->output_section->vma
8240 + plt->output_offset
8241 + h->plt.offset),
8242 htab->root.sgot->contents
8243 + (h->got.offset & ~(bfd_vma) 1));
8244 return TRUE;
8245 }
8246 }
8247 else if (info->shared && SYMBOL_REFERENCES_LOCAL (info, h))
a06ea964
NC		 8248 {
8249 if (!h->def_regular)
8250 return FALSE;
8251
8252 BFD_ASSERT ((h->got.offset & 1) != 0);
a6bb11b2 8253 rela.r_info = ELFNN_R_INFO (0, AARCH64_R (RELATIVE));
a06ea964
NC		 8254 rela.r_addend = (h->root.u.def.value
8255 + h->root.u.def.section->output_section->vma
8256 + h->root.u.def.section->output_offset);
8257 }
8258 else
8259 {
49206388 8260do_glob_dat:
a06ea964 8261 BFD_ASSERT ((h->got.offset & 1) == 0);
cec5225b 8262 bfd_put_NN (output_bfd, (bfd_vma) 0,
a06ea964 8263 htab->root.sgot->contents + h->got.offset);
a6bb11b2 8264 rela.r_info = ELFNN_R_INFO (h->dynindx, AARCH64_R (GLOB_DAT));
a06ea964
NC		 8265 rela.r_addend = 0;
8266 }
8267
8268 loc = htab->root.srelgot->contents;
8269 loc += htab->root.srelgot->reloc_count++ * RELOC_SIZE (htab);
cec5225b 8270 bfd_elfNN_swap_reloca_out (output_bfd, &rela, loc);
a06ea964
NC		 8271 }
8272
8273 if (h->needs_copy)
8274 {
8275 Elf_Internal_Rela rela;
8276 bfd_byte *loc;
8277
8278 /* This symbol needs a copy reloc. Set it up. */
8279
8280 if (h->dynindx == -1
8281 || (h->root.type != bfd_link_hash_defined
8282 && h->root.type != bfd_link_hash_defweak)
8283 || htab->srelbss == NULL)
8284 abort ();
8285
8286 rela.r_offset = (h->root.u.def.value
8287 + h->root.u.def.section->output_section->vma
8288 + h->root.u.def.section->output_offset);
a6bb11b2 8289 rela.r_info = ELFNN_R_INFO (h->dynindx, AARCH64_R (COPY));
a06ea964
NC		 8290 rela.r_addend = 0;
8291 loc = htab->srelbss->contents;
8292 loc += htab->srelbss->reloc_count++ * RELOC_SIZE (htab);
cec5225b 8293 bfd_elfNN_swap_reloca_out (output_bfd, &rela, loc);
a06ea964
NC		 8294 }
8295
8296 /* Mark _DYNAMIC and _GLOBAL_OFFSET_TABLE_ as absolute. SYM may
8297 be NULL for local symbols. */
8298 if (sym != NULL
9637f6ef 8299 && (h == elf_hash_table (info)->hdynamic
a06ea964
NC		 8300 || h == elf_hash_table (info)->hgot))
8301 sym->st_shndx = SHN_ABS;
8302
8303 return TRUE;
8304}
8305
1419bbe5
WN		 8306/* Finish up local dynamic symbol handling. We set the contents of
8307 various dynamic sections here. */
8308
8309static bfd_boolean
8310elfNN_aarch64_finish_local_dynamic_symbol (void **slot, void *inf)
8311{
8312 struct elf_link_hash_entry *h
8313 = (struct elf_link_hash_entry *) *slot;
8314 struct bfd_link_info *info
8315 = (struct bfd_link_info *) inf;
8316
8317 return elfNN_aarch64_finish_dynamic_symbol (info->output_bfd,
8318 info, h, NULL);
8319}
8320
a06ea964 8321static void
cec5225b
YZ		 8322elfNN_aarch64_init_small_plt0_entry (bfd *output_bfd ATTRIBUTE_UNUSED,
8323 struct elf_aarch64_link_hash_table
a06ea964
NC		 8324 *htab)
8325{
8326 /* Fill in PLT0. Fixme:RR Note this doesn't distinguish between
8327 small and large plts and at the minute just generates
8328 the small PLT. */
8329
cec5225b 8330 /* PLT0 of the small PLT looks like this in ELF64 -
a06ea964
NC		 8331 stp x16, x30, [sp, #-16]! // Save the reloc and lr on stack.
8332 adrp x16, PLT_GOT + 16 // Get the page base of the GOTPLT
8333 ldr x17, [x16, #:lo12:PLT_GOT+16] // Load the address of the
8334 // symbol resolver
8335 add x16, x16, #:lo12:PLT_GOT+16 // Load the lo12 bits of the
8336 // GOTPLT entry for this.
8337 br x17
cec5225b
YZ		 8338 PLT0 will be slightly different in ELF32 due to different got entry
8339 size.
a06ea964 8340 */
caed7120 8341 bfd_vma plt_got_2nd_ent; /* Address of GOT[2]. */
a06ea964
NC		 8342 bfd_vma plt_base;
8343
8344
cec5225b 8345 memcpy (htab->root.splt->contents, elfNN_aarch64_small_plt0_entry,
a06ea964
NC		 8346 PLT_ENTRY_SIZE);
8347 elf_section_data (htab->root.splt->output_section)->this_hdr.sh_entsize =
8348 PLT_ENTRY_SIZE;
8349
caed7120
YZ		 8350 plt_got_2nd_ent = (htab->root.sgotplt->output_section->vma
8351 + htab->root.sgotplt->output_offset
8352 + GOT_ENTRY_SIZE * 2);
a06ea964
NC		 8353
8354 plt_base = htab->root.splt->output_section->vma +
f44a1f8e 8355 htab->root.splt->output_offset;
a06ea964
NC		 8356
8357 /* Fill in the top 21 bits for this: ADRP x16, PLT_GOT + n * 8.
8358 ADRP: ((PG(S+A)-PG(P)) >> 12) & 0x1fffff */
caed7120
YZ		 8359 elf_aarch64_update_plt_entry (output_bfd, BFD_RELOC_AARCH64_ADR_HI21_PCREL,
8360 htab->root.splt->contents + 4,
8361 PG (plt_got_2nd_ent) - PG (plt_base + 4));
a06ea964 8362
caed7120
YZ		 8363 elf_aarch64_update_plt_entry (output_bfd, BFD_RELOC_AARCH64_LDSTNN_LO12,
8364 htab->root.splt->contents + 8,
8365 PG_OFFSET (plt_got_2nd_ent));
a06ea964 8366
caed7120
YZ		 8367 elf_aarch64_update_plt_entry (output_bfd, BFD_RELOC_AARCH64_ADD_LO12,
8368 htab->root.splt->contents + 12,
8369 PG_OFFSET (plt_got_2nd_ent));
a06ea964
NC		 8370}
8371
8372static bfd_boolean
cec5225b 8373elfNN_aarch64_finish_dynamic_sections (bfd *output_bfd,
a06ea964
NC		 8374 struct bfd_link_info *info)
8375{
cec5225b 8376 struct elf_aarch64_link_hash_table *htab;
a06ea964
NC		 8377 bfd *dynobj;
8378 asection *sdyn;
8379
cec5225b 8380 htab = elf_aarch64_hash_table (info);
a06ea964
NC		 8381 dynobj = htab->root.dynobj;
8382 sdyn = bfd_get_linker_section (dynobj, ".dynamic");
8383
8384 if (htab->root.dynamic_sections_created)
8385 {
cec5225b 8386 ElfNN_External_Dyn *dyncon, *dynconend;
a06ea964
NC		 8387
8388 if (sdyn == NULL || htab->root.sgot == NULL)
8389 abort ();
8390
cec5225b
YZ		 8391 dyncon = (ElfNN_External_Dyn *) sdyn->contents;
8392 dynconend = (ElfNN_External_Dyn *) (sdyn->contents + sdyn->size);
a06ea964
NC		 8393 for (; dyncon < dynconend; dyncon++)
8394 {
8395 Elf_Internal_Dyn dyn;
8396 asection *s;
8397
cec5225b 8398 bfd_elfNN_swap_dyn_in (dynobj, dyncon, &dyn);
a06ea964
NC		 8399
8400 switch (dyn.d_tag)
8401 {
8402 default:
8403 continue;
8404
8405 case DT_PLTGOT:
8406 s = htab->root.sgotplt;
8407 dyn.d_un.d_ptr = s->output_section->vma + s->output_offset;
8408 break;
8409
8410 case DT_JMPREL:
8411 dyn.d_un.d_ptr = htab->root.srelplt->output_section->vma;
8412 break;
8413
8414 case DT_PLTRELSZ:
c955de36 8415 s = htab->root.srelplt;
a06ea964
NC		 8416 dyn.d_un.d_val = s->size;
8417 break;
8418
8419 case DT_RELASZ:
8420 /* The procedure linkage table relocs (DT_JMPREL) should
8421 not be included in the overall relocs (DT_RELA).
8422 Therefore, we override the DT_RELASZ entry here to
8423 make it not include the JMPREL relocs. Since the
8424 linker script arranges for .rela.plt to follow all
8425 other relocation sections, we don't have to worry
8426 about changing the DT_RELA entry. */
8427 if (htab->root.srelplt != NULL)
8428 {
c955de36 8429 s = htab->root.srelplt;
a06ea964
NC		 8430 dyn.d_un.d_val -= s->size;
8431 }
8432 break;
8433
8434 case DT_TLSDESC_PLT:
8435 s = htab->root.splt;
8436 dyn.d_un.d_ptr = s->output_section->vma + s->output_offset
8437 + htab->tlsdesc_plt;
8438 break;
8439
8440 case DT_TLSDESC_GOT:
8441 s = htab->root.sgot;
8442 dyn.d_un.d_ptr = s->output_section->vma + s->output_offset
8443 + htab->dt_tlsdesc_got;
8444 break;
8445 }
8446
cec5225b 8447 bfd_elfNN_swap_dyn_out (output_bfd, &dyn, dyncon);
a06ea964
NC		 8448 }
8449
8450 }
8451
8452 /* Fill in the special first entry in the procedure linkage table. */
8453 if (htab->root.splt && htab->root.splt->size > 0)
8454 {
cec5225b 8455 elfNN_aarch64_init_small_plt0_entry (output_bfd, htab);
a06ea964
NC		 8456
8457 elf_section_data (htab->root.splt->output_section)->
8458 this_hdr.sh_entsize = htab->plt_entry_size;
8459
8460
8461 if (htab->tlsdesc_plt)
8462 {
cec5225b 8463 bfd_put_NN (output_bfd, (bfd_vma) 0,
a06ea964
NC		 8464 htab->root.sgot->contents + htab->dt_tlsdesc_got);
8465
8466 memcpy (htab->root.splt->contents + htab->tlsdesc_plt,
cec5225b
YZ		 8467 elfNN_aarch64_tlsdesc_small_plt_entry,
8468 sizeof (elfNN_aarch64_tlsdesc_small_plt_entry));
a06ea964
NC		 8469
8470 {
8471 bfd_vma adrp1_addr =
8472 htab->root.splt->output_section->vma
8473 + htab->root.splt->output_offset + htab->tlsdesc_plt + 4;
8474
caed7120 8475 bfd_vma adrp2_addr = adrp1_addr + 4;
a06ea964
NC		 8476
8477 bfd_vma got_addr =
8478 htab->root.sgot->output_section->vma
8479 + htab->root.sgot->output_offset;
8480
8481 bfd_vma pltgot_addr =
8482 htab->root.sgotplt->output_section->vma
8483 + htab->root.sgotplt->output_offset;
8484
8485 bfd_vma dt_tlsdesc_got = got_addr + htab->dt_tlsdesc_got;
caed7120
YZ		 8486
8487 bfd_byte *plt_entry =
8488 htab->root.splt->contents + htab->tlsdesc_plt;
a06ea964
NC		 8489
8490 /* adrp x2, DT_TLSDESC_GOT */
caed7120
YZ		 8491 elf_aarch64_update_plt_entry (output_bfd,
8492 BFD_RELOC_AARCH64_ADR_HI21_PCREL,
8493 plt_entry + 4,
8494 (PG (dt_tlsdesc_got)
8495 - PG (adrp1_addr)));
a06ea964
NC		 8496
8497 /* adrp x3, 0 */
caed7120
YZ		 8498 elf_aarch64_update_plt_entry (output_bfd,
8499 BFD_RELOC_AARCH64_ADR_HI21_PCREL,
8500 plt_entry + 8,
8501 (PG (pltgot_addr)
8502 - PG (adrp2_addr)));
a06ea964
NC		 8503
8504 /* ldr x2, [x2, #0] */
caed7120
YZ		 8505 elf_aarch64_update_plt_entry (output_bfd,
8506 BFD_RELOC_AARCH64_LDSTNN_LO12,
8507 plt_entry + 12,
8508 PG_OFFSET (dt_tlsdesc_got));
a06ea964
NC		 8509
8510 /* add x3, x3, 0 */
caed7120
YZ		 8511 elf_aarch64_update_plt_entry (output_bfd,
8512 BFD_RELOC_AARCH64_ADD_LO12,
8513 plt_entry + 16,
8514 PG_OFFSET (pltgot_addr));
a06ea964
NC		 8515 }
8516 }
8517 }
8518
8519 if (htab->root.sgotplt)
8520 {
8521 if (bfd_is_abs_section (htab->root.sgotplt->output_section))
8522 {
8523 (*_bfd_error_handler)
8524 (_("discarded output section: `%A'"), htab->root.sgotplt);
8525 return FALSE;
8526 }
8527
8528 /* Fill in the first three entries in the global offset table. */
8529 if (htab->root.sgotplt->size > 0)
8530 {
8db339a6
MS		 8531 bfd_put_NN (output_bfd, (bfd_vma) 0, htab->root.sgotplt->contents);
8532
a06ea964 8533 /* Write GOT[1] and GOT[2], needed for the dynamic linker. */
cec5225b 8534 bfd_put_NN (output_bfd,
a06ea964
NC		 8535 (bfd_vma) 0,
8536 htab->root.sgotplt->contents + GOT_ENTRY_SIZE);
cec5225b 8537 bfd_put_NN (output_bfd,
a06ea964
NC		 8538 (bfd_vma) 0,
8539 htab->root.sgotplt->contents + GOT_ENTRY_SIZE * 2);
8540 }
8541
8db339a6
MS		 8542 if (htab->root.sgot)
8543 {
8544 if (htab->root.sgot->size > 0)
8545 {
8546 bfd_vma addr =
8547 sdyn ? sdyn->output_section->vma + sdyn->output_offset : 0;
8548 bfd_put_NN (output_bfd, addr, htab->root.sgot->contents);
8549 }
8550 }
8551
a06ea964
NC		 8552 elf_section_data (htab->root.sgotplt->output_section)->
8553 this_hdr.sh_entsize = GOT_ENTRY_SIZE;
8554 }
8555
8556 if (htab->root.sgot && htab->root.sgot->size > 0)
8557 elf_section_data (htab->root.sgot->output_section)->this_hdr.sh_entsize
8558 = GOT_ENTRY_SIZE;
8559
1419bbe5
WN		 8560 /* Fill PLT and GOT entries for local STT_GNU_IFUNC symbols. */
8561 htab_traverse (htab->loc_hash_table,
8562 elfNN_aarch64_finish_local_dynamic_symbol,
8563 info);
8564
a06ea964
NC		 8565 return TRUE;
8566}
8567
8568/* Return address for Ith PLT stub in section PLT, for relocation REL
8569 or (bfd_vma) -1 if it should not be included. */
8570
8571static bfd_vma
cec5225b 8572elfNN_aarch64_plt_sym_val (bfd_vma i, const asection *plt,
a06ea964
NC		 8573 const arelent *rel ATTRIBUTE_UNUSED)
8574{
8575 return plt->vma + PLT_ENTRY_SIZE + i * PLT_SMALL_ENTRY_SIZE;
8576}
8577
8578
8579/* We use this so we can override certain functions
8580 (though currently we don't). */
8581
cec5225b 8582const struct elf_size_info elfNN_aarch64_size_info =
a06ea964 8583{
cec5225b
YZ		 8584 sizeof (ElfNN_External_Ehdr),
8585 sizeof (ElfNN_External_Phdr),
8586 sizeof (ElfNN_External_Shdr),
8587 sizeof (ElfNN_External_Rel),
8588 sizeof (ElfNN_External_Rela),
8589 sizeof (ElfNN_External_Sym),
8590 sizeof (ElfNN_External_Dyn),
a06ea964
NC		 8591 sizeof (Elf_External_Note),
8592 4, /* Hash table entry size. */
8593 1, /* Internal relocs per external relocs. */
cec5225b
YZ		 8594 ARCH_SIZE, /* Arch size. */
8595 LOG_FILE_ALIGN, /* Log_file_align. */
8596 ELFCLASSNN, EV_CURRENT,
8597 bfd_elfNN_write_out_phdrs,
8598 bfd_elfNN_write_shdrs_and_ehdr,
8599 bfd_elfNN_checksum_contents,
8600 bfd_elfNN_write_relocs,
8601 bfd_elfNN_swap_symbol_in,
8602 bfd_elfNN_swap_symbol_out,
8603 bfd_elfNN_slurp_reloc_table,
8604 bfd_elfNN_slurp_symbol_table,
8605 bfd_elfNN_swap_dyn_in,
8606 bfd_elfNN_swap_dyn_out,
8607 bfd_elfNN_swap_reloc_in,
8608 bfd_elfNN_swap_reloc_out,
8609 bfd_elfNN_swap_reloca_in,
8610 bfd_elfNN_swap_reloca_out
a06ea964
NC		 8611};
8612
8613#define ELF_ARCH bfd_arch_aarch64
8614#define ELF_MACHINE_CODE EM_AARCH64
8615#define ELF_MAXPAGESIZE 0x10000
8616#define ELF_MINPAGESIZE 0x1000
8617#define ELF_COMMONPAGESIZE 0x1000
8618
cec5225b
YZ		 8619#define bfd_elfNN_close_and_cleanup \
8620 elfNN_aarch64_close_and_cleanup
a06ea964 8621
cec5225b
YZ		 8622#define bfd_elfNN_bfd_free_cached_info \
8623 elfNN_aarch64_bfd_free_cached_info
a06ea964 8624
cec5225b
YZ		 8625#define bfd_elfNN_bfd_is_target_special_symbol \
8626 elfNN_aarch64_is_target_special_symbol
a06ea964 8627
cec5225b
YZ		 8628#define bfd_elfNN_bfd_link_hash_table_create \
8629 elfNN_aarch64_link_hash_table_create
a06ea964 8630
cec5225b
YZ		 8631#define bfd_elfNN_bfd_merge_private_bfd_data \
8632 elfNN_aarch64_merge_private_bfd_data
a06ea964 8633
cec5225b
YZ		 8634#define bfd_elfNN_bfd_print_private_bfd_data \
8635 elfNN_aarch64_print_private_bfd_data
a06ea964 8636
cec5225b
YZ		 8637#define bfd_elfNN_bfd_reloc_type_lookup \
8638 elfNN_aarch64_reloc_type_lookup
a06ea964 8639
cec5225b
YZ		 8640#define bfd_elfNN_bfd_reloc_name_lookup \
8641 elfNN_aarch64_reloc_name_lookup
a06ea964 8642
cec5225b
YZ		 8643#define bfd_elfNN_bfd_set_private_flags \
8644 elfNN_aarch64_set_private_flags
a06ea964 8645
cec5225b
YZ		 8646#define bfd_elfNN_find_inliner_info \
8647 elfNN_aarch64_find_inliner_info
a06ea964 8648
cec5225b
YZ		 8649#define bfd_elfNN_find_nearest_line \
8650 elfNN_aarch64_find_nearest_line
a06ea964 8651
cec5225b
YZ		 8652#define bfd_elfNN_mkobject \
8653 elfNN_aarch64_mkobject
a06ea964 8654
cec5225b
YZ		 8655#define bfd_elfNN_new_section_hook \
8656 elfNN_aarch64_new_section_hook
a06ea964
NC		 8657
8658#define elf_backend_adjust_dynamic_symbol \
cec5225b 8659 elfNN_aarch64_adjust_dynamic_symbol
a06ea964
NC		 8660
8661#define elf_backend_always_size_sections \
cec5225b 8662 elfNN_aarch64_always_size_sections
a06ea964
NC		 8663
8664#define elf_backend_check_relocs \
cec5225b 8665 elfNN_aarch64_check_relocs
a06ea964
NC		 8666
8667#define elf_backend_copy_indirect_symbol \
cec5225b 8668 elfNN_aarch64_copy_indirect_symbol
a06ea964
NC		 8669
8670/* Create .dynbss, and .rela.bss sections in DYNOBJ, and set up shortcuts
8671 to them in our hash. */
8672#define elf_backend_create_dynamic_sections \
cec5225b 8673 elfNN_aarch64_create_dynamic_sections
a06ea964
NC		 8674
8675#define elf_backend_init_index_section \
8676 _bfd_elf_init_2_index_sections
8677
a06ea964 8678#define elf_backend_finish_dynamic_sections \
cec5225b 8679 elfNN_aarch64_finish_dynamic_sections
a06ea964
NC		 8680
8681#define elf_backend_finish_dynamic_symbol \
cec5225b 8682 elfNN_aarch64_finish_dynamic_symbol
a06ea964
NC		 8683
8684#define elf_backend_gc_sweep_hook \
cec5225b 8685 elfNN_aarch64_gc_sweep_hook
a06ea964
NC		 8686
8687#define elf_backend_object_p \
cec5225b 8688 elfNN_aarch64_object_p
a06ea964
NC		 8689
8690#define elf_backend_output_arch_local_syms \
cec5225b 8691 elfNN_aarch64_output_arch_local_syms
a06ea964
NC		 8692
8693#define elf_backend_plt_sym_val \
cec5225b 8694 elfNN_aarch64_plt_sym_val
a06ea964
NC		 8695
8696#define elf_backend_post_process_headers \
cec5225b 8697 elfNN_aarch64_post_process_headers
a06ea964
NC		 8698
8699#define elf_backend_relocate_section \
cec5225b 8700 elfNN_aarch64_relocate_section
a06ea964
NC		 8701
8702#define elf_backend_reloc_type_class \
cec5225b 8703 elfNN_aarch64_reloc_type_class
a06ea964 8704
a06ea964 8705#define elf_backend_section_from_shdr \
cec5225b 8706 elfNN_aarch64_section_from_shdr
a06ea964
NC		 8707
8708#define elf_backend_size_dynamic_sections \
cec5225b 8709 elfNN_aarch64_size_dynamic_sections
a06ea964
NC		 8710
8711#define elf_backend_size_info \
cec5225b 8712 elfNN_aarch64_size_info
a06ea964 8713
68fcca92
JW		 8714#define elf_backend_write_section \
8715 elfNN_aarch64_write_section
8716
a06ea964 8717#define elf_backend_can_refcount 1
59c108f7 8718#define elf_backend_can_gc_sections 1
a06ea964
NC		 8719#define elf_backend_plt_readonly 1
8720#define elf_backend_want_got_plt 1
8721#define elf_backend_want_plt_sym 0
8722#define elf_backend_may_use_rel_p 0
8723#define elf_backend_may_use_rela_p 1
8724#define elf_backend_default_use_rela_p 1
2e0488d3 8725#define elf_backend_rela_normal 1
a06ea964 8726#define elf_backend_got_header_size (GOT_ENTRY_SIZE * 3)
c495064d 8727#define elf_backend_default_execstack 0
32f573bc 8728#define elf_backend_extern_protected_data 1
a06ea964
NC		 8729
8730#undef elf_backend_obj_attrs_section
8731#define elf_backend_obj_attrs_section ".ARM.attributes"
8732
cec5225b 8733#include "elfNN-target.h"
GDB Binutils - Deliverables
This page took 0.779157 seconds and 4 git commands to generate.